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CAN SCIENCE HELP? 




THE MISUSE OF SCIENCE 

By the middle of the seventeenth century it had come to be 
understood that the world was enclosed in a sea of air, much as the 
greater part of it was covered by water. A scientist of the period, 
Francesco Lana, contended that a lighter-than-air ship could float 
upon this sea, and he suggested how such a ship might be built. He 
was unable to put his invention to a practical test, but he saw only 

one reason why it might not work: 


that God will never suffer this Invention to take effect, because of 

the many consequcncies which may disturb the ° 

men. For who secs not, that no City can be secure against attack since 
our Ship may at any time be placed directly over it. and descending down 
may disdiargc Souldiers; the same would happen to private ® 

Ships on the Sea: for our Ship descending out of the Air to the sai of 
Sea Ships, it may cut their Ropes, yea without descending W cast ng 
Grapples it may over-set them, kill their men, burn their Ships by artifi¬ 
cial Fire works and Fire-balls. And this they may do not 
to great Buildings, Castles, Cities, with suA security that *ey ^mh east 
these things down from a height out of Gun-shot, cannot on the other 

side be offended by those below. 
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Lana’s reservation was groundless. He had predicted modem air 
warfare in surprisingly accurate detail—with its paratroopers and its 
strafing and bombing. Contrary to his expectation, God has suffered 
his invention to take effect. 

And so has Man. The story emphasizes the irresponsibility with 
which science and the products of science have been used. Man’s 
power appears to have increased out of all proportion to his wisdom. 
He has never been in a better position to build a healthy, happy, and 
productive world; yet things have perhaps never seemed so black. 
Two exhausting world wars in a single half century have given no 
assurance of a lasting peace. Dreams of progress toward a higher civi¬ 
lization have been shattered by the spectacle of the murder of mil¬ 
lions of innocent people. The worst may be still to come. Scientists 
may not set off a chain reaction to blow the world into eternity, but 
some of the more plausible prospects are scarcely less disconcert- 
ing. 

In the face of this apparently unnecessary condition men of good 
will find themselves helpless or afraid to act. Some are the prey of 
a profound pessimism. Others strike out blindly in counteraggression, 
much of which is directed toward science itself. Torn from its posi¬ 
tion of prestige, science is decried as a dangerous toy in the hands of 
children who do not understand it. The conspicuous feature of any 
period is likely to be blamed for its troubles, and in the twentieth 


century science must play the scapegoat. But the attack is not entirely 
without justification. Science has developed unevenly. By seizing 
upon the easier problems first, it has extended our control of inani¬ 


mate nature without preparing for the serious social problems which 
follow. The technologies based upon science are disturbing. Iso¬ 
lated groups of relatively stable people are brought into contact with 
each Other and lose their equilibrium. Industries spring up for which 
the life of a community may be unprepared, while others vanish 
leaving millions unfit for productive work. The application of science 
prevents famines and plagues, and lowers death rates—only to popu¬ 
late the earth beyond the reach of established systems of cultural or 
governmental control. Science has made war more terrible and more 
destructive. Much of this has not been done deliberately, but it has 
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been done. And since scientists are necessarily men of some intelli¬ 
gence, they might have been expected to be alert to these con¬ 
sequences. 

It is not surprising to encounter the proposal that science should 
be abandoned, at least for the time being. This solution appeals espe¬ 
cially to those who are fitted by temperament to other ways of life. 
Some relief might be obtained if we could divert mankind into a 
revival of the arts or religion or even of that petty quarreling which 
we now look back upon as a life of peace. Such a program resembles 
the decision of the citizens of Samuel Butler’s Erewhon. where the 
instruments and products of science were put into museum.—as ves¬ 
tiges of a stage in the evolution of human culture which did not 
survive. But not everyone is willing to defend a position of stubborn 
“not knowing.” There is no virtue in ignorance for its own sake. 
Unfortunately we cannot stand still: to bring scientific research to 
an end now would mean a return to famine and pestilence and the 
exhausting labors of a slave culture. 

SCIENCE AS A CORRECTIVE 

Another solution is more appealing to the modern mind. It may 
not be science which is wrong but only its application. The methods 
of science have been enormously successful wherever they have been 
tried. Let us then apply them to human affairs. We need not retreat 
in those sectors where science has already advanced. It is necessary 
only to bring our understanding of human nature up to the same 
point. Indeed, this may well be our only hope. If we can observe 
human behavior carefully from an objective point of view and come 
to understand it for what it is, we may be able to adopt a more 
sensible course of action. The need for establishing some such bal¬ 
ance is now widely felt, and those who are able to control the direc¬ 
tion of science are acting accordingly. It is understood that there is 
no point in furthering a science of nature unless it includes a sizable 
science of human nature, because only in that case will the results 
be wisely used. It is possible that science has come to the rescue and 
that or4er will eventually be achieved in the field of human affairs. 
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'HIE IIIREAT TO FREEDOM 

I’here is one difficulty, however. The application of science to 
human behavior is not so simple as it seems. Most of those who 
advocate it are simply looking for “the facts.” To them science is 
little more than careful observation. They want to evaluate human 
behavior as it really is rather than as it appears to be through igno¬ 
rance or prejudice, and then to make effective decisions and move on 
rapidly to a happier world. But the way in which science has been 
applied in other fields shows that something more is involved. Science 
is not concerned just with “getting the facts,” after which one may 
act with greater wisdom in an unscientific fashion. Science supplies 
its own wisdom. It leads to a new conception of a subject matter, a 
new way of thinking about that part of the world to which it has 
addressed itself. If we are to enjoy the advantages of science in the 
field of human affairs, we must be prepared to adopt the working 
model of behavior to which a science will inevitably lead. But very 
few of those who advocate the application of scientific method to 
current problems are willing to go that far. 

Science is more than the mere description of events as they occur. 
It is an attempt to discover order, to show that certain events stand 
in lawful relations to other events. No practical technology can be 
based upon science until such relations have been discovered. But 
order is not only a possible end product; it is a working assumption 
which must be adopted at the very start. We cannot apply the meth¬ 
ods of science to a subject matter which is assumed to move about 
capriciously. Science not only describes, it predicts. It deals not only 
with the past but with the future. Nor is prediction the last word: 
to the extent that relevant conditions can be altered, or otherwise 
controlled, the future can be controlled. If we are to use the methods 
of science in the field of human affairs, we must assume that behavior 
is lawful and determined. We must expect to discover that what a 
man does is the result of specifiable conditions and that once these 
conditions have been discovered, we can anticipate and to some ex¬ 
tent determine his actions. 

This possibility is offensive to many people. It is opposed to a tra- 



CAN SCIENCE HELP? 


dition of long standing which regards man as a free agent, whose 
behavior is the product, not of specifiable antecedent conditions, but 
of spontaneous inner changes of course. Prevailing philosophies of 
human nature recognize an internal “will which has the power of 
interfering with causal relationships and which makes the prediction 
and control of behavior impossible. To suggest that we abandon this 
view is to threaten many cherished beliefs—to undermine what ap¬ 
pears to be a stimulating and productive conception of human nature. 
The alternative point of view insists upon recognizing coercive forces 
in human conduct which we may prefer to disregard. It challenges 
our aspirations, cither worldly or otherworldly. Regardless of how 
much we stand to gain from supposing that human behavior is the 
proper subject matter of a science, no one who is a product of 
Western civilization can do so without a struggle. We simply do not 
want such a science. 

Conflicts of this sort are not unknown in the history of science. 
When Aesop's lion was shown a painting in which a man was de¬ 
picted killing a lion, he commented contemptuously, "The artist 
was obviously a man.” Primitive beliefs about man and his place in 
nature are usually flattering. It has been the unfortunate responsi¬ 
bility of science to paint more realistic pictures. The Copemican 
theory of the solar system displaced man from his pre-eminent posi¬ 
tion at the center of things. Today we accept this theory without 
emotion, but originally it met with enormous resistance. Darwin 
challenged a practice of segregation in which man set himself firmly 
apart from the animals, and the bitter struggle which arose is not yet 
ended. But though Darwin put man in his biological place, he did 
not deny him a possible position as master. Special faculties or a 
special capacity for spontaneous, creative action might have emerged 
in the process of evolution. When that distinction is now questioned, 

a new threat arises. 

There are many ways of hedging on the theoretical issue. It may be 
insisted that a science of human behavior is impossible, that behavior 
has certain essential features which forever keep it beyond the pale 
of science. But although this argument may dissuade many people 
from further inquiry, it is not likely to have any effect upon those 

iLibYary o ; « 
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wlio arc willing to tr) and see. Another objeetion frequently offered 
is that science is appropriate up to a certain point, but that there 
must always remain an area in which one can act only on faith or 
with respect to a “value judgment”: science may tell us how to deal 
with human behavior, but just what is to be done must be decided in 
an essentially nonscientific wav. Or it mav be argued that there is 
another kind of science which is compatible with doctrines of per¬ 
sonal freedom. For example, the social sciences arc sometimes said to 
be fundamentally different from the natural sciences and not con- 
cerned with the same kinds of lawfulness. Prediction and control 
may be forsworn in favor of “interpretation” or some other species 
of understanding. But the kinds of intellectual activities exemplified 
by value judgments or by intuition or interpretation have never been 
set forth clearly, nor have they yet shown any capacity to work a 
change in our present predicament. 

THE PRAC'I IC.AL ISSUE 

Our current practices do not represent any well-defined theoretical 
position. They are, in fact, thoroughly confused. At times we appear 
to regard a man's behavior as spontaneous and responsible. At other 
times we recognize that inner determination is at least not complete, 
that the individual is not always to be held to account. We have not 
been able to reject the slowly accumulating evidence that circum¬ 
stances beyond the individual are relevant. We sometimes exonerate 
a man by pointing to “extenuating circumstances.” We no longer 
blame the uneducated for their ignorance or call the unemployed 
lazy. We no longer hold children wholly accountable for their de¬ 
linquencies. "Ignorance of the law” is no longer wholly inexcusable; 
"Father, forgive them; for they know not what they do.” The insane 
have long since been cleared of responsibility for their condition, and 
the kinds of neurotic or psychotic behavior to which we now apply 
this extenuation are multiplying. 

But we have not gone all the way. We regard the common man as 
the product of his environment; yet we reserve the right to give 
personal credit to great men for their achievements. (At the same 
time we take a certain delight in proving that part of the output of 
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even such men is due to the “influence” of other men or to some 
trivial circumstance in their personal history.) We want to believe 
that right-minded men are moved by valid principles even though 
we are willing to regard wrong-minded men as victims of erroneous 
propaganda. Backward peoples may be the fault of a poor culture, but 
we want to regard the elite as something more than the product of 
a good culture. Though we obser\’e that Moslem children in general 
become Moslems while Christian children in general become Chris¬ 
tians, we are not willing to accept an accident of birth as a basis for 
belief. We dismiss those who disagree with us as victims of ignorance, 
but we regard the promotion of our own religious beliefs as some¬ 
thing more than the arrangement of a particular environment. 

All of this suggests that we are in transition. We have not wholly 
abandoned the traditional philosophy of human nature; at the same 
time we are far from adopting a scientific point of view without 
^eser^'ation. We have accepted the assumption of determinism in 
part; yet we allow our sympathies, our first allegiances, and our per¬ 
sonal aspirations to rise to the defense of the traditional view. We 
are currently engaged in a sort of patchwork in which new facts and 
methods are assembled in accordance with traditional theories. 

If this were a theoretical issue only, we would have no cause for 
alarm; but theories affect practices. A scientific conception of human 
behavior dictates one practice, a philosophy of personal freedom 
another. Confusion in theory means confusion in practice. The 
present unhappy condition of the world may in large measure be 
traced to our vacillation. The principal issues in dispute between 
nations, both in peaceful assembly and on the battlefield, are inti¬ 
mately concerned with the problem of human freedom and control. 
Totalitarianism or democracy, the state or the individual, planned 
society or laissez-faire, the impression of cultures upon alien peoples, 
economic determinism, individual initiative, propaganda, education, 
ideological warfare—all concern the fundamental nature of human 
behavior. We shall almost certainly remain ineffective in solving 
these problems until we adopt a consistent point of view. 

We cannot really evaluate the issue until we understand the alter¬ 
natives. The traditional view of human nature in Western culture 
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is well known. The conception of a free, responsible individual is 
embedded in our language and pervades our practices, codes, and 
beliefs. Given an example of human behavior, most people can de¬ 
scribe it immediately in terms of such a conception. The practice is 
so natural that it is seldom examined. A scientific formulation, on the 
other hand, is new and strange. Very few people have any notion of 
the extent to which a science of human behavior is indeed possible. 
In what way can the behavior of the individual or of groups of indi¬ 
viduals be predicted and controlled? What are laws of behavior like? 
What over all conception of the human organism as a behaving sys¬ 
tem emerges? It is only when we have answered these questions, at 
least in a preliminary fashion, that we may consider the implications 
of a science of human behavior with respect to either a theory of 
human nature or the management of human affairs. 



A SCIENCE OF BEHAVIOR 


The immediate tangible results of science make it easier to 
appraise than philosophy, poetry, art, or theology. As George Sarton 
has pointed out, science is unique in showing a cumulative progress. 
Newton explained his tremendous achievements by saying that he 
stood on the shoulders of giants. All scientists, whether giants or not, 
enable those who follow them to begin a little further along. This 
is not necessarily true elsewhere. Our contemporary writers, artists, 
and philosophers are not appreciably more effective than those of the 
golden age .of Greece, yet the average high-school student under¬ 
stands much more of nature than the greatest of Greek scientists. 
A comparison of the effectiveness of Greek and modem science is 

scarcely worth making. 

It is clear, then, that science “has something.” It is a unique 
intellectual process which yields remarkable results. The danger is 
that its astonishing accomplishments may conceal its true nature. 
This is especially important when we extend the methods of science 
to a new field. The basic characteristics of science are not restricted 
to any particular subject matter. When we study physics, cher^try, 
or biology, we study organized accumulations of information. Th^e 
are not science itself but the products of science. We may not be able 

11 
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to use much of this material when we enter new territory. Nor should 
wc allow ourselves to become enamored of instruments of research. 
\\ c tend to think of the scientist in his observatory or laboratory, 
with his telescopes, microscopes, and cyclotrons. Instruments give us 
a dramatic picture of science in action. But although science could 
not have gone ver\’ far without the devices which improve our contact 
with the surrounding world, and although any advanced science 
would be helpless without them, they are not science itself. We 
should not be disturbed if familiar instruments are lacking in a new 
field. Nor is science to be identified with precise measurement or 
mathematical calculation. It is better to be exact than inexact, and 
much of modern science would be impossible without quantitative 
obseivations and without the mathematical tools needed to convert 
its reports into more general statements; but we may measure or be 
mathematical without being scientific at all, just as we may be sciem 
tific in an elementary way without these aids. 

SOME IMPORTANT CHARACTERISTICS OF SCIENCE 

Science is first of all a set of attitudes. It is a disposition to deal 
with the facts rather than with what someone has said about them. 
Rejection of authority was the theme of the revival of learning, when 
men dedicated themselves to the study of “nature, not books.“ 
Science rejects even its own authorities when they interfere with the 
observation of nature. 

Science is a willingness to accept facts even when they are opposed 
to wishes. Thoughtful men have perhaps always known that we are 
likely tp see things as we want to see them instead of as they are, 
but thanks to Sigmund Freud we are today much more clearly aware 
of “wishful thinking." The opposite of wishful thinking is intellectual 
honesty—an extremely important possession of the successful scien¬ 
tist. Scientists are by nature no more honest than other men but, as 
Bridgman has pointed out, the practice of science puts an excep¬ 
tionally high premium on honesty. It is characteristic of science that 
any lack of honesty quickly brings disaster. Consider, for example, a 
scientist who conducts research to test a theory for which he is 
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already well known. The result may confirm his theor\', contradict it, 
or leave it in doubt. In spite of any inclination to the contrar\', he 
must report a contradiction just as readily as a confirmation. If he 
does not, someone else will—in a matter of weeks or months or at 
most a few years—and this will be more damaging to his prestige 
than if he himself had reported it. Where right and wrong are not so 
easily or so quickly established, there is no similar pressure. In the 
long run, the issue is not so much one of personal prestige as of 
effective procedure. Scientists have simply found that being honest 
—with oneself as much as with others—is essential to progress. 
Experiments do not always come out as one expects, but the facts 
must stand and the expectations fall. The subject matter, not the 
scientist, knows best. The same practical consequences have created 
the scientific atmosphere in which statements are constantly sub¬ 
mitted to check, where nothing is put above a precise description of 
the facts, and where facts are accepted no matter how distasteful 
their momentar}' consequences. 

Scientists have also discovered the value of remaining without an 
answer until a satisfactor)' one can be found. This is a difficult 
lesson. It takes considerable training to avoid premature conclusions, 
to refrain from making statements on insufficient evidence, and to 
avoid explanations which are pure invention. Yet the history' of 
science has demonstrated again and again the advantage of these 
practices. 

Science is, of course, more than a set of attitudes. It is a search for 
order, for uniformities, for lawful relations among the events in 
nature. It begins, as we all begin, by observing single episodes, but it 
quickly passes on to the general rule, to scientific law. Something 
very much like the order expressed in a scientific law appears in our 
behavior at an early age. W^e learn the rough geometry of the space 
in which we move. We learn the “laws of motion'’ as we move about, 
or push and pull objects, or throw and catch them. If we could not 
find some uniformity in the world, our conduct would remain hap¬ 
hazard and ineffective. Science sharpens and supplements this experi¬ 
ence by demonstrating more and more relations among events and 
by demonstrating them more and more precisely. As Ernst Mach 
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showed in tracing the histon^ of the science of mechanics, the earliest 
laws of science were probably the rules used by craftsmen and arti¬ 
sans in training apprentices. The rules saved time because the experi¬ 
enced craftsman could teach an apprentice a variety of details in a 
single formula. By learning a rule the apprentice could deal with 
particular cases-as they arose. 

In a later stage science advances from the collection of rules or laws 
to larger systematic arrangements. Not only does it make statements 
about the world, it makes statements about statements. It sets up a 
‘‘model” of its subject matter, which helps to generate new rules very 
much as the rules themselves generate new practices in dealing with 
single cases. A science may not reach this stage for some time. 

The scientific “system,” like the law, is designed to enable us to 
handle a subject matter more efficiently. What we call the scientific 
conception of a thing is not passive knowledge. Science is not con¬ 
cerned with contemplation. Wlien we have discovered the laws which 
govern a part of the world about us, and when we have organized 
these laws into a system, we are then ready to deal effectively with 
that part of the world. By predicting the occurrence of an event we 
are able to prepare for it. By ananging conditions in ways specified 
by the laws of a system, we not only predict, we control: we “cause” 
an event to occur or to assume certain characteristics. 

BEHAVIOR AS A SCIENTIFIC SUBJECT MATTER 

Behavior is not one of those subject matters which become acces¬ 
sible only with the invention of an instrument such as the telescope 
or microscope. We all know thousands of facts about behavior. 
Actually there is no subject matter with which we could be better 
acquainted, for we are always in the presence of at least one behaving 
organism. But this familiarity is something of a disadvantage, for it 
means that we have probably jumped to conclusions which will not 
be supported by the cautious methods of science. Even though we 
have obsers'ed behavior for many years, we are not necessarily able, 
without help, to express useful uniformities or lawful relations. We 
. 1 in making plausible guesses about what 
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our friends and acquaintances will do under various circumstances or 
what we ourselves will do. We may make plausible generalizations 
about the conduct of people in general. But ver>' few of these will 
sur^'ive careful analysis. A great deal of unlearning generally takes 
place in our early contact w'ith a science of behavior. 

Behavior is a difficult subject matter, not because it is inaccessible, 
but because it is extremely complex. Since it is a process, rather than 
a thing, it cannot easily be held still for observation. It is changing, 
fluid, and evanescent, and for this reason it makes great technical 
demands upon the ingenuity and energ>' of the scientist. But there is 
nothing essentially insoluble about the problems wdiich arise from 

this fact. 

Several kinds of statements about behavior are commonly made. 
When w-e tell an anecdote or pass along a bit of gossip, we report a 
single event—w'hat someone did upon such and such an occasion. 
“She slammed the door and walked off without a word. Our report 
is a small bit of biston,’. lliston- itself is often nothing more than 
similar reporting on a broad scale. The biographer often confines 
himself to a series of episodes in the life of his subject. The case 
history, which occupies an important place in several fields of psy- 
Cholog)', is a kind of biography which is also concerned mainly with 
what a particular person did at particular times and places: “When 
she was eleven, Mary went to live with her maiden aunt in Win¬ 
chester.” Novels and short stories may be thought of as veiled biog¬ 
raphy or history, since the ingredients of even a highly fanciful work 
of fiction are somehow or other taken from life. The narrative report¬ 
ing of the behavior of people at particular times and places is also 
part of the sciences of archeolog)', ethnolog)', sociolog)', and anthro- 

polog)'. , 

These accounts have their uses. They broaden the experience of 

those who have not had firsthand access to similar data. But they are 
only the beginnings of a science. No matter how accurate or quanti¬ 
tative it may be, the report of the single case is only a preliminary 
step. The next step is the discovery of some sort of uniformity. When 
we tell an anecdote to support an argument, or report a case history 
to exemplify a principle, we imply a general rule, no matter how 
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vaguely it may be expressed. The historian is seldom content with 
mere narration. He reports his facts to support a theory—of cycles, 
trends, or patterns of historv'. In doing so he passes from the single 
instance to the rule. When a biographer traces the influence of an 
carlv event upon a man’s later life, he transcends simple reporting 
and asserts, no matter how hesitantly, that one thing has caused 
another. Fable and allcgoiy' are more than storytelling if they imply 
some kind of uniformity in human behavior, as they generally do. 
Our preference for “consistency of character” and our rejection of 
implausible coincidences in literature show that we expect lawfulness. 
The “manners” and “customs” of the sociologist and anthropologist 
report the general behavior of groups of people. 

A vague sense of order emerges from any sustained observation of 
human behavior. Any plausible guess about what a friend will do or 
say in a given circumstance is a prediction based upon some such 
uniformity. If a reasonable order was not discoverable, we could 
scarcely be effective in dealing with human affairs. TTe methods of 
science are designed to clarify these uniformities and make them 
explicit. The techniques of field study of the anthropologist and 
social psychologist, the procedures of the psychological clinic, and 
the controlled experimental methods of the laboratory are all directed 
toward this end, as are also the mathematical and logical tools of 
science. 

Many people interested in human behavior do not feel the need 
for the standards of proof characteristic of an exact science; the 
uniformities in behavior are “obvious” without them. At the same 
time, they are reluctant to accept the conclusions toward which such 
proof inescapably points if they do not "sense” the uniformity them¬ 
selves. But these idiosyncrasies are a costly luxury. We need not 
defend the methods of science in their application to behavior. The 
experimental and mathematical techniques used in discovering and 
expressing uniformities are the common property of science in gen¬ 
eral. Almost every discipline has contributed to this pool of resources, 

and all disciplines borrow from it. The advantages are well estab¬ 
lished. 
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SOME OBJECTIONS TO A SCIENCE OF BEU W'IOR 

The report of a single event raises no theoretical problems and 
comes into no conflict with philosophies of human behavior. The 
scientific laws or systems which express uniformities are likely to 
conflict with theor)' because they claim the same territory. When a 
science of behavior reaches the point of dealing with lawful rela¬ 
tionships, it meets the resistance of those who give their allegiance 
to prescientific or extrascientific conceptions. The resistance does not 
always take the form of an overt rejection of science. It may be trans¬ 
muted into claims of limitations, often expressed in highly scientific 

terms. v • i 

It has sometimes been pointed out, for example, that physical 

science has been unable to maintain its philosophy of determinism, 
particularly at the subatomic level. The Principle of Indeterminacy 
states that there are circumstances under which the physicist cannot 
put himself in possession of all relevant information: if he chooses 
to observe one event, he must relinquish the possibility of observing 
another. In our present state of knowledge, certain events therefore 
appear to be unpredictable. It does not follow that these events are 
free or capricious. Since human behavior is enormously complex and 
the human organism is of limited dimensions, many acts may involve 
processes to which the Principle of Indeterminacy applies. It does 
not follow that human behavior is free, but only that it may be 
beyond the range of a predictive or controlling science. Most students 
of behavior, however, would be willing to settle for the degree of 
prediction and control achieved by the physical sciences in spite of 
this limitation. A final answer to the problem of lawfulness is to be 
sought, not in the limits of any hypothetical mechanism within the 
organism, but in our ability to demonstrate lawfulness in the be¬ 
havior of the organism as a whole. 

A similar objection has a logical flavor. It is contended that reason 

cannot comprehend itself or-in somewhat more substantial terms- 
that the behavior required in understanding one's own behavior must 
be something beyond the behavior which is understood. It is tme 
that knowledge is limited by the limitations of the knowing organism. 


tiihrary 
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The number of things in the world which might be known certainly 
exceeds the number of possible different states in all possible knowers. 
But the laws and systems of science are designed to make a knowl¬ 
edge of particular events unimportant. It is by no means necessary 
that one man should understand all the facts in a given field, but 
only that he should understand all the kinds of facts. We have no 
reason to suppose that the human intellect is incapable of formulat¬ 
ing or comprehending the basic principles of human behavior—cer¬ 
tainly not until we have a clearer notion of what those principles are. 

The assumption that behavior is a lawful scientific datum some¬ 
times meets with another objection. Science is concerned with the 
general, but the behavior of the individual is necessarily unique. 
The "case history” has a richness and flavor which are in decided 
contrast with general principles. It is easy to convince oneself that 
there arc two distinct worlds and that one is beyond the reach of 
science. This distinction is not peculiar to the study of behavior. 
It can always be made in the early stages of any science, when it is 
not clear what we may deduce from a general principle with respect 
to a particular case. What the science of physics has to say about the 
world is dull and colorless to the beginning student when compared 
with his daily experience, but he later discovers that it is actually a 
more incisive account of even the single instance. When we wish to 
deal effectively with the single instance, we turn to science for help. 
Tlie argument will lose cogency as a science of behavior progresses 
and as the implications of its general laws become clear. A com¬ 
parable argument against the possibility of a science of medicine has 
already lost its significance. In Wur and Peace, Tolstoy wrote of the 
illness of a favorite character as follows: 

Doctors came to see Natasha, both separately and in consultation. They 
said a great deal in h'rench, in German, and in Latin. They criticised one 
another, and prescribed the most diverse remedies for all the diseases they 
were familiar with. But it never oecurred to one of them to make the 
simple reflection that they could not understand the disease from which 
Natasha was suffering, as no single disease can be fully understood in a 
living person; for every living person has his individual peculiarities and 
always has his own peculiar, new, complex complaints unkno^vn to 
medicine—not a disease of the lungs, of the kidneys, of the skin, of the 
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heart, and so on, as described in medieal books, but a disease that consists 
of one out of the innumerable combinations of ailments of those organs. 

Tolstoy was justified in calling ever)’ sickness a unique event. Every 
action of the individual is unique, as well as ever)' event in physics 
and chemistr)'. But his objection to a science of medicine in terms of 
uniqueness was unwarranted. Tlie argument was plausible enough at 
the time; no one could then contradict him by supplying the neces- 
sai)’ general principles. But a great deal has happened in medical 
science since then, and today few people would care to argue that 
a disease cannot be described in general terms or that a single case 
cannot be discussed by referring to factors common to many cases. 
The intuitive wisdom of the old-style diagnostician has been largely 
replaced by the analytical procedures of the clinic, just as a scientific 
analysis of behavior will eventually replace the personal interpretation 
of unique instances. 

A similar argument is leveled at the use of statistics in a science 
of behavior. A prediction of what the average individual will do is 
often of little or no value in dealing with a particular individual. 
The actuarial tables of life-insurance companies are of no value to a 
physician in predicting the death or survival of a particular patient. 
This issue is still alive in the physical sciences, where it is associated 
with the concepts of causality and probability. It is seldom that the 
science of physics deals with the behavior of individual molecules, 
atoms, or subatomic particles. When it is occasionally called upon 
to do so, all the problems of the particular event arise. In general a 
science is helpful in dealing with the individual only insofar as its 
laws refer to individuals. A science of behavior which concerns only 
the behavior of groups is not likely to be of help in our understand¬ 
ing of the particular case. But a science may also deal with the be¬ 
havior of the individual, and its success in doing so must be evaluated 
in terms of its achievements rather than any a priori contentions. 

The extraordinary complexit)' of behavior is sometimes held to 
be an added source of difficulty. Even though behavior may be 
lawful, it may be too complex to be dealt with in terms of law. Sir 
Oliver Lodge once asserted that “though an astronomer can calculate 
the orbit of a planet or comet or even a meteor, although a physicist 
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can deal with the structure of atoms, and a chemist with their pos¬ 
sible combinations, neither a biologist nor any scientific man can 
calculate the orbit of a common fly. This is a statement about the 
limitations of scientists or about their aspirations, not about the 
suitability of a subject matter. Even so, it is wrong. It may be said 
witli some assurance that if no one has calculated the orbit of a fly, 
it is only because no one has been sufficiently interested in doing so. 
The tropistic movements of many insects arc now fairly well under¬ 
stood. but the instrumentation needed to record the flight of a fly 
and to give an account of all the conditions affecting it would cost 
more than the importance of the subject justifies. There is, therefore, 
no reason to conclude, as the author does, that "an incalculable ele¬ 
ment of self-determination thus makes its appearance quite low down 
the animal scale." Self-determination does not follow from com¬ 
plexity. Difficulty in calculating the orbit of the fly does not prove 
capriciousness, though it may make it impossible to prove anything 
else. The problems imposed by the complexity of a subject matter 
must be dealt with as they arise. Apparently hopeless cases often 
become manageable in time. It is only recently that any sort of law¬ 
ful account of the weather has been possible. We often succeed in 
reducing complexity to a reasonable degree by simplifying conditions 
in the laboratory; but where this is impossible, a statistical analysis 
may be used to achieve an inferior, but in many ways acceptable, 
prediction. Certainly no one is prepared to say now what a science of 
behavior can or cannot accomplish eventually. Advance estimates of 
the limits of science have generally proved inaccurate. The issue is 
in the long run pragmatic: we cannot tell until we have tried. 

Still another objection to the use of scientific method in the study 
of human behavior is that behavior is an anomalous subject matter 
because a prediction made about it may alter it. If we tell a friend 
that he is going to buy a particular kind of car, he may react to our 
prediction by buying a different kind. The same effect has been used 
to explain the failures of public opinion polls. In the presidential 
election of 1948 it was confidently predicted that a majority of the 
voters would vote for a candidate who, as it turned out, lost the 
election. It has been asserted that the electorate reacted to the pre- 
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diction in a contrary way and that the published prediction therefore 
had an effect upon the predicted event. But it is by no means neces¬ 
sary^ that a prediction of behavior be permitted to affect the behaving 
individual. There may have been practical reasons why the results of 
the poll in question could not be withheld until after the election, 
but this would not be the case in a purely scientific endeavor. 

There are other ways in which obsers'er and obsen’ed interact. 
Study distorts the thing studied. But there is no special problem here 
peculiar to human behavior. It is now accepted as a general principle 
in scientific method that it is necessaiy' to interfere in some degree 
with any phenomenon in the act of obsen ing it. A scientist may have 
an effect upon behavior in the act of observing or analyzing it, and 
he must certainly take this effect into account. But behavior may 
also be obser\'ed with a minimum of interaction between subject 
and scientist, and this is the case with which one naturally tries to 
begin. 

A final objection deals with the practical application of a scientific 
analysis. Even if we assume that behavior is lawful and that the 
methods of science will reveal the rules which govern it, we may 
be unable to make any technological use of these rules unless certain 
conditions can be brought under control. In the laboratory many 
conditions are simplified and irrelevant conditions often eliminated. 
But of what value are laboratory studies if we must predict and con¬ 
trol behavior where a comparable simplification is impossible? It is 
true that we can gain control over behavior only insofar as we can 
control the factors responsible for it. What a scientific study does is 
to enable us to make optimal use of the control we possess. The 
laboratory simplification reveals the relevance of factors which we 
might otherwise overlook. 

We cannot avoid the problems raised by a science of behavior by 
simply denying that the necessary conditions can be controlled. In 
actual fact there is a considerable degree of control over many 
relevant conditions. In penal institutions and military organizations 
the control is extensive. We control the environment of the human 
organism in the nursery and in institutions which care for those to 
whom the conditions of the nursery remain necessary in later life. 
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Fairly extensive control of conditions relevant to human behavior is 
maintained in industr>' in the form of wages and conditions of work, 
in schools in the form of grades and conditions of work, in commerce 
by anyone in possession of goods or money, by governmental agencies 
through the police and militar)', in the psychological clinic through 
the consent of the controllee, and so on. A degree of effective control, 
not so easily identified, rests in the hands of entertainers, writers, 
advertisers, and propagandists. These controls, which are often all 
too evident in their practical application, are more than sufficient 
to permit us to extend the results of a laboratory science to the inter¬ 
pretation of human behavior in daily affairs—for either theoretical 
or practical purposes. Since a science of behavior will continue to 
increase the effective use of this control, it is now more important 
than ever to understand the processes involved and to prepare our¬ 
selves for the problems which will certainly arise. 



CHAPTER III 


WHY ORGANISMS BEHAVE 


The terms “cause” and “effect” are no longer widely used 
in science. Tliey have been associated with so many theories of the 
structure and operation of the universe that they mean more than 
scientists want to say. The terms which replace them, however, refer 
to the same factual core. A “cause” becomes a “change in an inde¬ 
pendent variable” and an “effect” a “change in a dependent variable.” 
The old “cause-and-effect connection” becomes a “functional rela¬ 
tion.” The new terms do not suggest how a cause causes its effect; 
they merely assert that different events tend to occur together in a 
certain order. Tliis is important, but it is not crucial. There is no 
particular danger in using “cause” and “effect” in an informal discus¬ 
sion if we are always ready to substitute their more exact counter¬ 
parts. 

We are concerned, then, with the causes of human behavior. We 
want to know why men behave as they do. Any condition or event 
which can be shown to have an effect upon behavior must be taken 
into account. By discovering and analyzing these causes we can 
predict behavior; to the extent that we can manipulate them, we can 
control behavior. 

Tliere is a curious inconsistency in the zeal with which the doctrine 

23 
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of personal freedom has been defended, because men have always 
been fascinated by the search for causes. The spontaneity of human 
behavior is apparently no more challenging than its why and where¬ 
fore.” So strong is the urge to explain behavior that men have been 
led to anticipate legitimate scientific inquiry' and to construct highly 
implausible theories of causation. This practice is not unusual in the 
histors' of science. The study of any subject begins in the realm of 
superstition. The fanciful explanation precedes the valid. Astronomy 
began as astrolog)'; chemistr\' as alchemy. The field of behavior has 
had, and still has, its astrologers and alchemists. A long history of 
prescicntific explanation furnishes us with a fantastic array of causes 
which have no function other than to supply spurious answers to 
questions which must otherwise go unanswered in the early stages 
of a science. 

SOME POPULAR ' CAUSES” OF BEHAVIOR 

Any conspicuous event which coincides with human behavior is 
likely to be seized upon as a cause. The position of the planets at the 
birth of the individual is an example. Usually astrologers do not try 
to predict specific actions from such causes, but when they tell us 
that a man will be impetuous, careless, or thoughtful, we must sup¬ 
pose that specific actions are assumed to be affected. Numerology 
finds a different set of causes—for example, in the numbers which 
compose the street address of the individual or in the number of 
letters in his name. Millions of people turn to these spurious causes 
every year in their desperate need to understand human behavior 
and to deal with it effectivelv. 

Tlie predictions of astrologers, numerologists, and the like are 
usually so vague that they cannot be confirmed or disproved properly. 
Failures are easily overlooked, while an occasional chance hit is 
dramatic enough to maintain the behavior of the devotee in con¬ 
siderable strength. Certain valid relations which resemble such 
superstitions offer spurious support. For example, some characteris¬ 
tics of behavior can be traced to the season in which a man is born 
(though not to the position of the planets at his birth), as well as to 
climatic conditions due in part to the position of the earth in the 
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solar system or to events in the sun. Effects of this sort, when 
properly validated, must not be overlooked. T hey do not, of course, 
justify astrology. 

Another common practice is to explain behavior in terms of the 

structure of the individual. The proportions of the body, the shape 

of the head, the color of the eves, skin, or hair, the marks on the 

# 

palms of the hands, and the features of the face have all been said 
to determine what a man will do. The “jovial fat man,” Cassius with 
his “lean and hungr)' look,” and thousands of other characters or 
types thoroughly embedded in our language affect our practices in 
dealing with human behavior. A specific act may never be predicted 
from physique, but different types of personality imply predisposi¬ 
tions to behave in different ways, so that specific acts arc presumed 
to be affected. This practice resembles the mistake wc all make when 
we expect someone who looks like an old acquaintance to behave 
like him also. When a “type” is once established, it sim ives in even- 
day use because the predictions which arc made with it, like those 
of astrolog)', are vague, and occasional hits may be startling. Spurious 
support is also offered by many valid relations between behavior and 
body type. Studies of the physiques of men and women predisposed 
to different sorts of disorders have from time to time held the atten¬ 
tion of students of behavior. The most recent classification of body 
structure—the somatotyping of W. H. Sheldon—has already been 
applied to the prediction of temperament and of various fonns of 
delinquency. Valid relations between behavior and body type must, 
of course, be taken into account in a science of behavior, but these 
should not be confused with the relations invoked in the uncritical 
practice of the layman. 

Even when a correlation between behavior and body structure is 
demonstrated, it is not always clear which is the cause of which. Even 
if it could be shown by proper statistical methods that fat men are 
especially likely to be jolly, it still would not follow that the physique 
causes the temperament. Fat people are at a disadvantage in many 
ways, and they may develop jolly behavior as a special competitive 
technique. Jolly people may grow fat because they are free of the 
emotional disturbances which drive other people to overwork or to 
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neglect their diet or their health. Fat people may be jolly because 
they have been successful in satisfying their needs through excessive 
eating. Where the feature of physique can be modified, then, 
we must ask whether the behavior or the feature comes first. 

When we find, or think we have found, that conspicuous physical 
features explain part of a man's behavior, it is tempting to suppose 
that inconspicuous features explain other parts. This is implied in 
the assertion that a man shows certain behavior because he was “bom 
that way.” To object to this is not to argue that behavior is never 
determined by hereditary' factors. Behavior requires a behaving 
organism which is the product of a genetic process. Gross differences 
in the behavior of different species show that the genetic constitu¬ 
tion, whether obser\'cd in the body structure of the individual or 
inferred from a genetic history, is important. But the doctrine of 
"being born that way” has little to do with demonstrated facts. It 
is usually an appeal to ignorance. “Heredity,” as the layman uses the 
term, is a fictional explanation of the behavior attributed to it. 

Even when it can be shown that some aspect of behavior is due 
to season of birth, gross body type, or genetic constitution, the fact is 
of limited use. It may help us in predicting behavior, but it is of little 
value in an experimental analysis or in practical control because such 
a condition cannot be manipulated after the individual has been con¬ 
ceived. The most that can be said is that the knowledge of the genetic 
factor may enable us to make better use of other causes. If we know 
that an individual has certain inherent limitations, we may use our 
techniques of control more intelligently, but we cannot alter the 
genetic factor. 

The practical deficiencies of programs involving causes of this 
sort may explain some of the vehemence with which they are com¬ 
monly debated. Many people study human behavior because they 
want to do something about it—they want to make men happier, 
more efficient and productive, less aggressive, and so on. To these 
people, inherited determiners—as epitomized in various “racial types” 
—appear to be insurmountable barriers, since they leave no course of 
action but the slow and doubtful program of eugenics. The evidence 
for genetic traits is therefore closely scrutinized, and any indication 
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that it is weak or inconsistent is received with cntluisiasm. But the 
practical issue must not be allowed to interfere in determining the 
extent to wliich behavioral dispositions are inherited. The matter is 
not so eriicial as is often supposed, for we shall see that there are 
other types of causes available for those who want quicker results. 


INNER “CAUSES" 

Ever\' science has at some time or other looked for causes of action 
inside the things it has studied. Sometimes the practice has proved 
useful, sometimes it has not. There is nothing wrong with an inner 
explanation as such, but events which arc located inside a system are 
likely to be difficult to observe. For this reason we arc encouraged to 
assign properties to them without justification. Worse still, wc can 
invent causes of this sort without fear of contradiction. The motion 
of a rolling stone was once attributed to its vis viva. The chemical 
properties of bodies were thought to be derived from the principles 
or essences of which they were composed. Combustion was explained 
by the phlogistoTi inside the combustible object. Wounds healed and 
bodies grew well because of a vis medicatrix. It has been especially 
tempting to attribute the behavior of a living organism to the be¬ 
havior of an inner agent, as the following examples may suggest. 


Neural causes. The layman uses the neiAOus system as a ready 
explanation of behavior. The English language contains hundreds of 
expressions which imply such a causal relationship. At the end of a 
long trial we read that the ]ur\* shows signs of brain fag, that the 
nen’es of the accused are on edge, that the wife of the accused is on 
the verge of a nervous breakdown, and that his lawyer is generally 
thought to have lacked the brains needed to stand up to the prosecu¬ 
tion. Obviously, no direct observ'ations have been made of the ner\'Ous 
systems of any of these people. Their “brains ’ and nerx'es have 
been invented on the spur of the moment to lend substance to what 
might otherwise seem a superficial account of their behavior. 

The sciences of neurology and physiology' have not divested them¬ 
selves entirely of a similar practice. Since techniques for observing 
the electrical and chemical processes in neiAOUs tissue had not yet 


Library 



y'ytap 




College. 



28 IIIE rOSSlPII ITY OF A SCIENCE OF HUMAN BEHAVIOR 

been developed, early information about the ner\' 0 us system was 
limited to its gross anatomy. Neural processes could only be inferred 
from the behavior which was said to result from them. Such infer- 
cnees were legitimate enough as scientific theories, but they could 
not justifiablv be used to explain the very behavior upon which they 
were based. I'hc hvpotheses of the early physiologist may have been 
sounder than those of the layman, but until independent evidence 
could be obtained, they were no more satisfactory as explanations of 
behavior. Direct information about many of the chemical and elec¬ 
trical processes in the nersous system is now available. Statements 
about the nervous system are no longer necessarily inferential or 
fictional. Rut there is still a measure of circularity in much physio¬ 
logical explanation, even in the writings of specialists. In World War 
I a familiar disorder was called “shell shock.” Disturbances in be¬ 
havior were explained bv arguing that violent explosions had damaged 
the structure of the neiA'ous system, though no direct evidence of 
such damage was available. In World War II the same disorder was 
classified as “neuropsychiatric.” Tlie prefix seems to show a continu¬ 
ing unwillingness to abandon explanations in terms of hypothetical 
neural damage. 

Eventually a science of the nervous system based upon direct 
observation rather than inference will describe the neural states and 
events which immediately precede instances of behavior. We shall 
know the precise neurological conditions which immediately precede, 
say, the response, “No, thank you.” TTiese events in turn will be 
found to be preceded by other neurological events, and these in turn 
by others. This scries will lead us back to events outside the nervous 
system and, eventually, outside the organism. In the chapters which 
follow we shall consider external events of this sort in some detail. 
We shall then be better able to evaluate the place of neurological 
explanations of behavior. However, we may note here that we do not 
have and may never have this sort of neurological information at the 
moment it is needed in order to predict a specific instance of be¬ 
havior. It is even more unlikely that we shall be able to alter the 
nervous system directly in order to set up the antecedent conditions 
of a particular instance. The causes to be sought in the nervous sys- 
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tern are, therefore, of limited usefulness in the prediction and control 
of specific behavior. 

Psychic inner causes. An even more common practice is to explain 
behavior in terms of an inner agent which lacks physical dimensions 
and is called “mental” or “psychic.” The purest form of the psychic 
explanation is seen in the animism of primitive peoples. From the 
immobilitv of the body after death it is inferred that a spirit respon¬ 
sible for movement has departed. The enthusiastic person is, as the 
etymolog)' of the word implies, energized by a “god within.” It is 
only a modest refinement to attribute ever\’ feature of the behavior 
of the physical organism to a corresponding feature of the “mind” 
or of some inner “personality.’' The inner man is regarded as driving 
the body very much as the man at the steering wheel drives a car. 
The inner man wills an action, the outer executes it. The inner 
loses his appetite, the outer stops eating. The inner man wants and 
the outer gets. The inner has the impulse which the outer obeys. 

It is not the layman alone who resorts to these practices, for many 
reputable psychologists use a similar dualistic system of explanation. 
The inner man is sometimes personified clearly, as when delinquent 
behavior is attributed to a “disordered personality,” or he may be 
dealt with in fragments, as when behavior is attributed to mental 
processes, faculties, and traits. Since the inner man does not occupy 
space, he may be multiplied at will. It has been argued that a single 
physical organism is controlled by several psychic agents and that its 
behavior is the resultant of their several wills. The Freudian con¬ 
cepts of the ego, superego, and id are often used in this way. They 
are frequently regarded as nonsubstantial creatures, often in violent 
conflict, whose defeats or victories lead to the adjusted or maladjusted 
behavior of the physical organism in which they reside. 

Direct observation of the mind comparable with the observation 
of the nervous system has not proved feasible. It is true that many 
people believe that they observe their “mental states” just as the 
physiologist observes neural events, but another interpretation of 
what they observe is possible, as we shall see in Chapter XVII. Intro¬ 
spective psychology no longer pretends to supply direct information 
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abouf events which are the causal antecedents, rather than the mere 
accompaniments, of behavior. It defines its subjective events in 
ways wliich strip them of any usefulness in a causal analysis. The 
events appealed to in early mentalistic explanations of behavior have 
remained bevond the reach of obser\ation. Freud insisted upon this 
by emphasizing the role of the unconscious—a frank recognition 
tliat important mental processes are not directly observable. The 
Freudian literature supplies many examples of behavior from which 
unconscious wishes, impulses, instincts, and emotions are inferred. 
Unconscious thought-processes have also been used to explain intel¬ 
lectual achievements. Though the mathematician may feel that he 
knows “how he thinks," he is often unable to give a coherent account 
of the mental processes leading to the solution of a specific problem. 
But anv mental event which is unconscious is necessarily inferential, 
and the explanation is therefore not based upon independent obser¬ 
vations of a valid cause. 

The fictional nature of this form of inner cause is shown by the 
ease with which the mental process is discovered to have just the 
properties needed to account for the behavior. WTen a professor 
turns up in the wrong classroom or gives the wrong lecture, it is be¬ 
cause his mind is, at least for the moment, absent. If he forgets to 
give a reading assignment, it is because it has slipped his mind (a hint 
from the class may remind him of it). He begins to tell an old joke 
but pauses for a moment, and it is evident to everyone that he is 
tr\ing to make up his mind whether or not he has already used the 
joke that term. His lectures grow more tedious with the vears, and 
questions from the class confuse him more and more, because his 
mind is failing. What he says is often disorganized because his ideas 
arc confused. He is occasionally unnecessarily emphatic because of 
the force of his ideas. When he repeats himself, it is because he has 
an idee fixe; and when he repeats what others have said, it is because 
he borrows his ideas. Upon occasion there is nothing in what he says 
because he lacks ideas. In all this it is obvious that the mind and the 
ideas, together with their special characteristics, are being invented 
on the spot to provide spurious explanations. A science of behavior 
can hope to gain very little from so cavalier a practice. Since mental 
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or psychic events are asserted to lack the dimensions of physical 
science, we have an additional reason for rejecting them. 

Conceptual inner causes. Tlie commonest inner causes have no 
specific dimensions at all, cither neurological or psychic. When we 
sav that a man eats because he is hungry, smokes a great deal because 
he has the tobacco habit, fights because of the instinct of pugnacity, 
behaves brilliantly because of his intelligence, or plays the piano well 
because of his musical ability, we seem to be referring to causes. But 
on analysis these phrases prove to be merely redundant descriptions. 
A single set of facts is described by the two statements: “He eats” 
and “He is hungr\'.” A single set of facts is described by the two state¬ 
ments: “He smokes a great deal” and “He has the smoking habit.” 
A single set of facts is described by the two statements: “He plays 
well” and “He has musical ability.” The practice of explaining one 
statement in terms of the other is dangerous because it suggests that 
we have found the cause and therefore need search no further. More¬ 
over, such terms as “hunger,” “habit,” and “intelligence” convert 
what are essentially the properties of a process or relation into what 
appear to be things. Thus we are unprepared for the properties even- 
tuallv to be discovered in the behavior itself and continue to look 
for something which may not exist. 

THE VARIABLES OF W HICH BEHAVIOR IS A FUNCTION 

The practice of looking inside the organism for an explanation of 
behavior has tended to obscure the variables which are immediately 
available for a scientific analysis. These variables lie outside the 
organism, in its immediate environment and in its environmental 
histone They have a physical status to which the usual techniques 
of science are adapted, and they make it possible to explain behavior 
as other subjects are explained in science. Tliese independent vari¬ 
ables are of many sorts and their relations to behavior are often 
subtle and complex, but we cannot hope to give an adequate account 
of behavior without analyzing them. 

Consider the act of drinking a glass of water. This is not likely to 
be an important bit of behavior in anyone’s life, but it supplies a 
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convenient example. We may describe the topography of the be¬ 
havior in such a way that a given instance may be identified quite 
accurately by anv qualified observer. Suppose now we bring someone 
into a room and place a glass of water before him. Will he drink? 
riicrc appear to be only two possibilities: cither he will or he will 
not. but we speak of the chances that he will drink, and this notion 
may be refined for scientific use. What we want to evaluate is the 
probability that he will drink. This may range from virtual certainty 
that drinking will occur to virtual certainty that it will not. The verx' 
considerable problem of how to measure such a probability will be 
discussed later. For the moment, we are interested in how the proba- 

bilitv mav be increased or decreased. 

F\cryday experience suggests several possibilities, and laboratory 
and clinical observations have added others. It is decidedly not true 
that a horse may be led to water but cannot be made to drink. By 
arranging a histors- of severe deprivation we could be “absolutely 
sure" that drinking would occur. In the same way we may be sure 
that the glass of water in our experiment will be drunk. Although we 
are not likely to arrange them experimentally, deprivations of the 
ncccssarv magnitude sometimes occur outside the laboratoiy'. We may 
obtain an effect similar to that of deprivation by speeding up the 
excretion of water. For example, we may induce sweating by raising 
the temperature of the room or by forcing heavy exercise, or we may 
increase the excretion of urine by mixing salt or urea in food taken 
prior to the experiment. It is also well known that loss of blood, as 
on a battlefield, sharply increases the probability^ of drinking. On the 
other hand, we may set the probability at virtually zero by inducing 
or forcing our subject to drink a large quantity of water before the 
experiment. 

If we are to predict whether or not our subject will drink, we must 
know as much as possible about these variables. If we are to induce 
him to drink, we must be able to manipulate them. In both cases, 
moreover, either for accurate prediction or control, we must investi¬ 
gate the effect of each variable quantitatively with the methods and 
techniques of a laboratory science. 

Other variables may, of course, affect the result. Our subject may 
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be “afraid” that something has been added to the water as a practical 
joke or for experimental purposes. lie may even “suspect” that the 
water has been poisoned. He may have grown up in a culture in 
which water is drunk only when no one is watching. He may refuse 
to drink simply to prove that we cannot predict or control his be¬ 
havior. These possibilities do not disprove the relations between 
drinking and the variables listed in the preceding paragraphs; they 
simply remind us that other variables may have to be taken into 
account. W^e must know the histoiA' of our subject with respect to 
the behavior of drinking water, and if we cannot eliminate social 
factors from the situation, then we must know the history of his 
personal relations to people resembling the experimenter. Adequate 
prediction in any science requires information about all relevant 
variables, and the control of a subject matter for practical purposes 
makes the same demands. 

Other tvpes of “explanation” do not permit us to dispense with 
these requirements or to fulfill them in any easier way. It is of no 
help to be told that our subject will drink provided he was born 
under a particular sign of the zodiac which shows a preoccupation 
with water or provided he is the lean and thirsty type or was, in 
short, “born thirsty.” Explanations in terms of inner states or agents, 
however, may require some further comment. To what extent is it 
helpful to be told, “He drinks because he is thirsty”? If to be thirsty 
means nothing more than to have a tendency to drink, this is mere 
redundancy. If it means that he drinks because of a state of thirst, 
an inner causal event is invoked. If this state is purely inferential— 
if no dimensions are assigned to it which would make direct obsena- 
tion possible—it cannot seiA'e as an explanation. But if it has physio¬ 
logical or psychic properties, what role can it play in a science of 
behavior? 

The physiologist may point out that several ways of raising the 
probability of drinking have a common effect: they increase the con¬ 
centration of solutions in the body. Through some mechanism not yet 
well understood, this may bring about a corresponding change in the 
nervous system which in turn makes drinking more probable. In the 
same way, it may be argued that all these operations make the organ- 
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ism “feel thirsty" or “want a drink” and that such a psychic state 
also acts upon the nervous system in some unexplained way to induce 
drinking. In each case we have a causal chain consisting of three 
links: (1) an operation performed upon the organism from without— 
for example, water deprivation; (2) an inner condition—for example, 
physiological or psvehic thirst; and (3) a kind of behavior for exam¬ 
ple. drinking. Independent information about the second link would 
obviously permit us to predict the third without recourse to the 6rst. 
It would be a preferred type of variable because it would be non- 
historic; the first link may lie in the past histor)' of the organism, but 
the second is a current condition. Direct information about the 
second link is, however, seldom, if ever, av'ailable. Sometimes we infer 
the second link from the third: an animal is judged to be thirsty if 
it drinks. In that case, the explanation is spurious. Sometimes we 
infer the second link from the first: an animal is said to be thirsty if 
it has not drunk for a long time. In that case, we obviously cannot 
dispense with the prior historj'. 

The second link is useless in the control of behavior unless we can 
manipulate it. At the moment, we have no way of directly altering 
neural processes at appropriate moments in the life of a behaving 
organism, nor has any way been discovered to alter a psychic process. 
We usually set up the second link through the first: we make an 
animal thirsty, in either the physiological or the psychic sense, by 
depriving it of water, feeding it salt, and so on. In that case, the 
second link obviously does not permit us to dispense with the first. 
Even if some new technical discovery were to enable us to set up or 
change the second link directly, we should still have to deal with 
those enormous areas in which human behavior is controlled through 
manipulation of the first link. A technique of operating upon the 
second link would increase our control of behavior, but the tech¬ 
niques which have already been developed would still remain to be 
analyzed. 

Tire most objectionable practice is to follow the causal sequence 
back only as far as a hypothetical second link. This is a serious handi¬ 
cap both in a theoretical science and in the practical control of 
behavior. It is no help to be told that to get an organism to drink we 
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are simply to “make it thirsty” unless we are also told how this is to 
be done. When we have obtained the necessary’ prescription for 
thirst, the whole proposal is more complex than it need be. SiinilarK’, 
when an example of maladjusted behavior is explained by sa\ ing that 
the individual is “suffering from anxiety,” we have still to be told the 
cause of the anxiety. But the external conditions which are then 
invoked could have been directly related to the maladjusted behavior. 
Again, when we are told that a man stole a loaf of bread because “he 
was hungr)%” we have still to learn of the external conditions respon¬ 
sible for the "hunger.” I’hese conditions would have sufficed to 
explain the theft. 

The objection to inner states is not that they do not exist, but 
that thev are not relevant in a functional analysis. We cannot account 
for the behavior of any s\stem while staying wholly inside it; even¬ 
tually we must turn to forces operating upon the organism from with¬ 
out. Unless there is a weak spot in our causal chain so that the second 

link is not lawfully determined bv the first, or the third by the 

« * 

second, then the first and third links must be lawfully related. If we 
must always go back bc)ond the second link for prediction and con¬ 
trol, we may avoid many tiresome and exhausting digressions by 
examining the third link as a function of the first. Valid information 
about the second link may throw light upon this relationship but 
can in no way alter it. 

A FUNCTIONAL ANALYSIS 

Tlie external variables of which behavior is a function provide for 
what may be called a causal or functional analysis. We undertake 
to predict and control the behavior of the individual organism. 1 his 
is our “dependent variable”—the effect for which we are to find the 
cause. Our “independent variables"—the causes of behavior—arc the 
external conditions of which behavior is a function. Relations be¬ 
tween the two—the “cause-and-effect relationships” in behavior- 
are the laws of a science. A synthesis of these laws expressed in quan¬ 
titative terms yields a comprehensive picture of the organism as a 
behaving system. 

This must be done within the bounds of a natural science. We 
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cannot assiiine that behavior has any peculiar properties which re¬ 
quire unique methods or special kinds of knowledge. It is often 
argued that an act is not so important as the “intent" which lies 
behind it. or that it can be described only in terms of what it means 
to the behaving individual or to others whom it may affect. If state¬ 
ments of this sort are useful for scientific purposes, they must be 
based upon observable events, and we may confine ourselves to such 
events exclusively in a functional analysis. We shall see later that 
although such terms as “meaning” and “intent” appear to refer to 
properties of behavior, they usually conceal references to independent 
variables. This is also true of “aggressive,” “friendly," “disorganized,” 
“intelligent,” and other terms which appear to describe properties 
of behavior but in realit>^ refer to its controlling relations. 

The independent variables must also be described in physical terms. 
An effort is often made to avoid the labor of analyzing a physical 
situation by guessing what it “means” to an organism or by dis¬ 
tinguishing between the physical world and a psychological world 
of “experience.” Tliis practice also reflects a confusion between 
dependent and independent variables. The events affecting an organ¬ 
ism must be capable of description in the language of physical science. 
It is sometimes argued that certain “social forces or the influences 
of culture or tradition are exceptions. But we cannot appeal to 
entities of this sort without explaining how they can affect both the 
scientist and the individual under observation. The physical events 
which must then be appealed to in such an explanation will supply 
us with alternative material suitable for a physical analysis. 

By confining ourselves to these observable events, we gain a con¬ 
siderable advantage, not only in theory, but in practice. A “social 
force” is no more useful in manipulating behavior than an inner 
state of hunger, anxiety, or skepticism. Just as we must trace these 
inner events to the manipulable variables of which they are said to 
be functions before we may put them to practical use, so we must 
identify the physical events through which a “social force” is said 
to affect the organism before we can manipulate it for purposes of 
control. In dealing with the directly observable data we need not 
refer to either the inner state or the outer force. 
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The material to be analyzed in a science of behavior comes from 
many sources; 

(1) Our casual obserrations are not to be dismissed entirely. They 
are especially important in the early stages of investigation. Gen¬ 
eralizations based upon them, even without explicit analysis, supply 
useful hunches for further study. 

(2) In controlled field observation, as exemplified by some of the 
methods of anthropology, the data arc sampled more carefully and 
conclusions stated more explicitly than in casual observation. Standard 
instruments and practices increase the accuracy and uniformity of 
held obseiA’ation. 

(3) Clinical obsen’ation has supplied extensive material. Standard 
practices in inteiv iewing and testing bring out behavior which may be 
easily measured, summarized, and compared with the behavior of 
others. Although it usually emphasizes the disorders which bring 
people to clinics, the clinical sample is often unusually interesting and 
of special value when the exceptional condition points up an 
important feature of behavior. 

(4) Extensive obserx^ations of behavior have been made under 
more rigidly controlled conditions in industrial, military, and other 
institutional research. This work often differs from field or clinical 
observation in its greater use of the experimental method. 

(5) laboratory studies of human behavior provide especially use¬ 
ful material. Tlie experimental method includes the use of instru¬ 
ments which improve our contact with behavior and with the vari¬ 
ables of which it is a function. Recording devices enable us to observ'C 
behavior over long periods of time, and accurate recording and 
measurement make effective quantitative analysis possible. The most 
important feature of the laboratory' method is the deliberate manipu¬ 
lation of variables: the importance of a given condition is determined 
by changing it in a controlled fashion and observing the result. 

Current experimental research on human behavior is sometimes 
not so comprehensive as one might wish. Not all behavioral processes 
are easy to set up in the laboratory, and precision of measurement is 
sometimes obtained only at the price of unreality in conditions. 
Those who are primarily concerned with the everyday life of the 
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individual are often impatient with these artificialities, but insofar 
as relevant relationships can be brought under experimental control, 
the laborator)' offers the best chance of obtaining the quantitative 

results needed in a scientific analysis. 

(6) The extensive results of laboratory studies of the behavior of 
auirtjals below the human level are also available. The use of this 
material often meets with the objection that there is an essential gap 
between man and the other animals, and that the results of one 
cannot be extrapolated to the other. To insist upon this discontinuity 
at the beginning of a scientific investigation is to beg the question. 
Human behavior is distinguished by its complexity, its variety, and 
its greater accomplishments, but the basic processes are not therefore 
necessarily different. Science advances from the simple to the com¬ 
plex; it is constantly concerned with whether the processes and laws 
discovered at one stage are adequate for the next. It would be rash 
to assert at this point that there is no essential difference between 
human behavior and the behavior of lower species; but until an 
attempt has been made to deal with both in the same terms, it would 
be equally rash to assert that there is. A discussion of human embry¬ 
ology' makes considerable use of research on the embryos of chicks, 
pigs, and other animals. Treatises on digestion, respiration, circula¬ 
tion, endocrine secretion, and other physiological processes deal with 
rats, hamsters, rabbits, and so on, even though the interest is pri¬ 
marily in human beings, ^’he study of behavior has much to gain 
from the same practice. 

We study the behavior of animals because it is simpler. Basic 
processes are resealed more easily and can be recorded over longer 
periods of time. Our obseiT'ations are not complicated by the social 
relation between subject and experimenter. Conditions may be better 
controlled. We may arrange genetic histories to control certain 
variables and special life histories to control others—for example, 
if we are interested in how an organism learns to see, we can raise 
an animal in darkness until the experiment is begun. We are also able 
to control current circumstances to an extent not easily realized in 
human behavior—for example, we can vary states of deprivation over 
wide ranges. These are advantages which should not be dismissed 
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on the a priori contention that human behavior is inevitably set 
apart as a separate field. 

ANALYSIS OF THE DATA 

There are many ways in which data concerning human behavior 
may be formulated and analyzed. The plan to be followed in the 
present book may be summarized as follows: 

Section n contains a classification of the variables of which be¬ 
havior is a function and a survey of the processes through which 
behavior changes when any of these variables is changed. 

Section iii provides a broader view of the organism as a whole. 
Certain complex arrangements are considered in which one part of 
the behavior of the individual alters some of the variables of which 
other parts are a function. These are the activities which wc describe 
by saying, for example, that the individual “controls himself,” 
“thinks out a solution to a problem,” or “is aware of his own be¬ 
havior.” ... , . 

Section rv analyzes the interaction of two or more individuals in a 

social system. One person is often part of the environment of another, 
and this relationship is usually reciprocal. An adequate account of a 
given social episode explains the behavior of all participants. 

Section v analyzes various techniques through which human be¬ 
havior is controlled in government, religion, psychotherapy, eco¬ 
nomics, and education. In each of these fields the individual and the 
controlling agency constitute a social system in the sense of Sec- 

tion iv. 

Section vi surveys the total culture as a social environment, and dis¬ 
cusses the general problem of the control of human behavior. 

The plan is obviously an example of extrapolation from the simple 
to the complex. No principle is used in any part of the book which 
is not discussed in Section ii. The basic relations and processes of 
this section are derived from data obtained under conditions which 
most closely approximate those of an exact science. In Section v 
complex examples of human behavior drawn from certain established 
fields of knowledge are analyzed in terms of these simpler processes 
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and relations. The procedure is often referred to as reductionism. 
If onr interest is primarily in the basic process, we turn to material 
of this sort as a test of the adequacy of our analysis. If, on the other 
hand, our interest is primarily in the complex case, we still have much 
to gain in utilizing a formulation which has been worked out under 
more favorable circumstances. For example, historical and compara¬ 
tive facts about particular governments, religions, economic systems, 
and so on have led to certain traditional conceptions of the behaving 
individual, but each of these conceptions has been appropriate only 
to the particular set of facts from which it was derived. This restric¬ 
tion has proved to be a serious handicap. Tlie conception of man 
which has emerged from the study of economic phenomena has been 
of little or no value in the field of psychotherapy. The conception of 
human behavior developed for use in the field of education has had 
little or nothing in common with that employed in explaining gov¬ 
ernmental or legal practices. A basic functional analysis, however, 
provides us with a common formulation of the behavior of the indi¬ 
vidual with which we may discuss issues in all these areas and even¬ 
tually consider the effect upon the individual of the social environ¬ 
ment as a whole. 

Certain limitations in dealing with historical and comparative facts 
may be acknowledged. We are often asked to explain more about 
human behavior than is asked of other scientists in their respective 
fields. How can we account for the behavior of literary or historical 
figures? Why could Hamlet not kill his uncle to avenge his father’s 
murder? What were Robespierre’s real motives? How can we explain 
Leonardo’s paintings? Was Hitler paranoid? Questions of this sort 
have tremendous human interest. Many psychologists, historians, 
biographers, and literary critics have tried to answer them, and there 
is therefore a strong presumption that they can be answered. But 
this may not be so. We lack the information needed for a functional 
analysis. Although we can make plausible guesses as to the variables 
which operated in each case, we cannot be sure. Comparable ques¬ 
tions in the fields of physics, chemistry, and biology can be answered 
only in the same limited way. Why did the old Campanile in the 
Piazza San Marco collapse into a heap of brick? The physicist may 
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know how mortar was made at the time the Campanile was built, 
in what atmospheric conditions it disintegrated, and so on; yet, 
although he may give a plausible explanation, he cannot with cer¬ 
tainty account for the collapse. The meteorologist cannot account for 
the flood which bore Noah’s ark to Mount Ararat, nor the biologist 
for the extinction of the dodo. The specialist may give the most 
plausible explanation of a historical event, but if necessary informa¬ 
tion is lacking, he cannot give a rigorous account within the frame¬ 
work of a science. The scientist is under greater pressure to answer 
comparable questions about human behavior. He may feel, or be 
forced to accept, the challenge of those who pretend to give valid 
answers. Moreover, his answers may be of great practical importance. 
The clinician, for example, may be urged to interpret the behavior 
of Ills patient when the available information is far from adequate, 
and it is often more difficult for him than for the physicist to say 
that he does not know. 

The commonest objection to a thoroughgoing functional analysis 
is simply that it cannot be carried out, but the only evidence for this 
is that it has not yet been carried out. We need not be discouraged 
by this fact. Human behavior is perhaps the most difficult subject to 
which the methods of science have ever been applied, and it is only 
natural that substantial progress should be slow. It is encouraging 
to reflect, however, that science seldom moves at an even pace. 
Progress is sometimes arrested for a long time merely because the 
particular aspect of a subject which is emphasized proves unimportant 
and unproductive. A slight change in point of attack is enough to 
bring rapid progress. Chemistr)^ made great strides when it was rec¬ 
ognized that the weights of combining substances, rather than their 
qualities or essences, were the important things to study. The science 
of mechanics moved forw'ard rapidly when it was discovered that dis¬ 
tances and times were more important for certain purposes than 
size, shape, color, hardness, and weight. Many different properties 
or aspects of behavior have been studied for many years with vary¬ 
ing degrees of success. A functional analysis which specifies behavior 
as a dependent variable and proposes to account for it in terms of 
observable and manipulable physical conditions is of recent advent. 
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It has already shown itself to be a promising formulation, and until 
it has been put to the test, we have no reason to prophesy failure. 

Such a plan cannot be carried out at a superficial level. The 
engineer who builds a bridge successfully has more than a casual 
impression of the nature of his materials, and the time has come 
when we must admit that we cannot solve the important problems 
in human affairs with a general “philosophy of human behavior.” 
The present analysis requires considerable attention to detail. Nu¬ 
merical data have been avoided, but an attempt has been made to 
define each behavioral process rigorously and to exemplify each 
process or relation with specific instances. If the reader is to partici¬ 
pate fully in the broader interpretations of the later sections, he will 
have to examine these definitions and to observe the distinctions 
which they make between different processes. Tliis may be hard work, 
but there is no help for it. Human behavior is at least as difficult a 
subject matter as the chemistry of organic materials or the structure 
of the atom. Superficial sketches of what science has to say about 
any subject are often entertaining, but they are never adequate for 
effective action. If we are to further our understanding of human 
behavior and to improve our practices of control, we must be pre¬ 
pared for the kind of rigorous thinking which science requires. 
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CHAPTER lY 


REFLEXES AND CONDITIONED 

REFLEXES 


MAN A MACHINE 

Behavior is a primary characteristic of living things. We 
almost identify it with life itself. Anything which moves is likely to 
be called alive—especially when the movement has direction or acts 
to alter the environment. Movement adds verisimilitude to any 
model of an organism. The puppet comes to life when it moves, and 
idols which move or breathe smoke are especially awe-inspiring. 
Robots and other mechanical creatures entertain us just because 
they move. And there is significance in the etymology of the 
animated cartoon. 

Machines seem alive simply because they are in motion. The fasci¬ 
nation of the steam shovel is legendary'. Less familiar machines may 
actually be frightening. We may feel that it is only primitive people 
who mistake them for living creatures today, but at one time they 
were unfamiliar to evers'one. Wlren Wordsworth and Coleridge once 
passed a steam engine, Wordsworth observed that it was scarcely 
possible to divest oneself of the impression that it had life and 
volition, “Yes,” said Coleridge, “it is a giant with one idea.” 
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A mechanical toy which imitated human behavior led to the 
theor)' of what we now call reflex action. In the first part of the 
seventeenth century' certain moving figures were commonly installed 
in private and public gardens as sources of amusement. They were 
operated hydraulically. A young lady walking through a garden might 
step upon a small concealed platform. This would open a valve, 
water would flow into a piston, and a threatening figure would swing 
out from the bushes to frighten her. Rene Descartes knew how these 
figures worked, and he also knew how much they seemed like living 
creatures. He considered the possibility- that the hydraulic system 
which explained the one might also explain the other. A muscle 
swells when it moves a limb—perhaps it is being inflated by a fluid 
coming along the nerx-es from the brain. The nerves which stretch 
from the surface of the body into the brain may be the strings 
which open the valves. 

Descartes did not assert that the human organism always operates 
in this way. He favored the explanation in the case of animals, but 
he reserved a sphere of action for the “rational soul”—perhaps under 
religious pressure. It was not long before the additional step was 
taken, however, which produced the full-fledged doctrine of “man 
a machine.” The doctrine did not owe its popularity to its plausibility 
—there was no reliable support for Descartes’s theory—but rather to 
its shocking metaphysical and theoretical implications. 

Since that time two things have happened: machines have become 
more lifelike, and living organisms have been found to be more like 
machines. Contemporary' machines are not only more complex, they 
are deliberately designed to operate in ways which resemble human 
behavior. “Almost human” contrivances are a common part of our 
daily experience. Doors see us coming and open to receive us. Ele¬ 
vators remember our commands and stop at the correct floor. Me¬ 
chanical hands lift imperfect items off a conveyor belt. Others write 
messages of fair legibility. Mechanical or electric calculators solve 
equations too difficult or too time-consuming for human mathema¬ 
ticians. Man has, in short, created the machine in his own image. 
And as a result, the living organism has lost some of its uniqueness. 
We are much less awed bv machines than our ancestors were and 
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less likely to endow the giant with even one idea. At the same time, 
we have discovered more about how the living organism works and 
are better able to see its machine-like properties. 

REFLEX ACTION 

Descartes had taken an important step in suggesting that some of 
the spontaneity of living creatures was only apparent and that be¬ 
havior could sometimes be traced to action from without. 1 he first 
clear-cut evidence that he had correctly surmised the possibility of 
external control came two centuries later in the discovery' that the 
tail of a salamander would move when part of it was touched or 
pierced, even though the tail had been severed from the body. Facts 
of this sort are now familiar, and we have long since adapted our 
beliefs to take them into account. At the time the discovery was 
made, however, it created great excitement. It was felt to be a serious 
threat to prevailing theories of the inner agents responsible for be¬ 
havior. If the movement of the amputated tail could be controlled 
by external forces, was its behavior when attached to the salamander 
of a different nature? If not, what about the inner causes which had 
hitherto been used to account for it? It was seriously suggested as an 
answer that the “will” must be coexistent with the body and that 
some part of it must invest any amputated part. But the fact re¬ 
mained that an external event had been identified which could be 
substituted, as in Descartes’s daring hypothesis, for the inner 
explanation. 

The external agent came to be called a stimulus. The behavior 
controlled by it came to be called a response. Together they com¬ 
prised what was called a reflex—on the theory' that the disturbance 
caused by the stimulus passed to the central ner\'ous system and was 
“reflected" back to the muscles. It was soon found that similar ex¬ 
ternal causes could be demonstrated in the behavior of larger portions 
of the organism—for example, in the body' of a frog, cat, or dog in 
which the spinal cord had been severed at the neck. Reflexes includ¬ 
ing parts of the brain were soon added, and it is now common 
knowledge that in the intact organism many kinds of stimulation 
lead to almost inevitable reactions of the same reflex nature. Many 
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characteristics of the relation have been studied quantitatively. The 
time which elapses between stimulus and response (the "latency”) 
has been measured precisely. The magnitude of the response has 
been studied as a function of the intensity of the stimulus. Other 
conditions of the organism have been found to be important in com¬ 
pleting the account—for example, a reflex may be “fatigued” by 
repeated rapid elicitation. 

The reflex was at first closely identified with hypothetical neural 
events in the so-called “reflex arc.” A surgical division of the organism 
was a necessar\' entering wedge, for it provided a simple and dra¬ 
matic method of analyzing behavior. But surgical analysis became 
unnecessary as soon as the principle of the stimulus was understood 
and as soon as techniques were discovered for handling complex 
arrangements of variables in other ways. By eliminating some condi¬ 
tions, holding others constant, and var>'ing others in an orderly 
manner, basic lawful relations could be established without dissection 
and could be expressed without neurological theories. 

The extension of the principle of the reflex to include behavior 
involving more and more of the organism was made only in the face 
of vigorous opposition. The reflex nature of the spinal animal was 
challenged by proponents of a “spinal will.” The evidence they 
offered in support of a residual inner cause consisted of behavior 
which apparently could not be explained wholly in terms of stimuli. 
When higher parts of the nervous system were added, and when the 
principle was eventually extended to the intact organism, the same 
pattern of resistance was followed. But arguments for spontaneity, 
and for the explanatory entities which spontaneity seems to demand, 
are of such form that they must retreat before the accumulating facts. 
Spontaneity is negative evidence; it points to the weakness of a 
current scientific explanation, but does not in itself prove an alterna¬ 
tive version. By its vei)' nature, spontaneity must yield ground as a 
scientific analysis is able to advance. As more and more of the be¬ 
havior of the organism has come to be explained in terms of stimuli, 
the territory held by inner explanations has been reduced. The “will” 
has retreated up the spinal cord, through the lower and then the 
higher parts of the brain, and finally, with the conditioned reflex, has 
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escaped through the front of the head. At each stage, some part of 
the control of the organism has passed from a hypothetical inner 
entity to the external environment. 

THE RANGE OF REFLEX ACTION 

A certain part of behavior, then, is elicited by stimuli, and our 
prediction of that behavior is especially precise. When we flash a 
light in the eye of a normal subject, the pupil contracts. When he 
sips lemon juice, saliva is secreted. When wc raise the temperature 
of the room to a certain point, the small blood vessels in his skin 
enlarge, blood is brought nearer to the skin, and he “turns red.” We 
use these relations for many practical purposes. When it is necessary 
to induce vomiting, we employ a suitable stimulus—an irritating 
fluid or a finger in the throat. The actress who must cr>' real tears 
resorts to onion juice on her handkerchief. 

As these examples suggest, many reflex responses are executed by 
the “smooth muscles” (for example, the muscles in the walls of the 
blood vessels) and the glands. Tliese structures are particularly con¬ 
cerned with the internal economy of the organism. They are most 
likely to be of interest in a science of behavior in the emotional 
reflexes to be discussed in Chapter X. Other reflexes use the “striped 
muscles” which move the skeletal frame of the organism. The “knee 
jerk” and other reflexes which the physician uses for diagnostic pur¬ 
poses are examples- \Ve maintain our posture, either when standing 
still or moving about, with the aid of a complex network of such 
reflexes. 

In spite of the importance suggested by these examples, it is still 
true that if we were to assemble all the behavior which falls into the 
pattern of the simple reflex, we should have only a very small fraction 
of the total behavior of the organism. This is not what early investi¬ 
gators in the field expected. We now see that the principle of the 
reflex was overworked. The exhilarating discovery of the stimulus led 
to exaggerated claims. It is neither plausible nor expedient to con¬ 
ceive of the organism as a complicated jack-in-the-box with a long 
list of tricks, each of which may be evoked by pressing the proper 
button. The greater part of the behavior of the intact organism is not 
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under this primitive sort of stimulus control. The environment affects 
the organism in many ways which are not conveniently classed as 
"stimuli;' and even in the field of stimulation only a small part of 
the forces acting upon the organism elicit responses in the invariable 
manner of reflex action. To ignore the principle of the reflex entirely, 
however, would be equally unwarranted. 

CONDH IONED REELEXES 

The reflex became a more important instrument of analysis when 
it was shown that novel relations between stimuli and responses could 
be established during the lifetime of the individual by a process first 
studied by the Russian physiologist, I. P. Pavlov. H. G. Wells once 
compared Pavlov with another of his distinguished contemporaries, 
George Bernard Shaw. He considered the relative importance to 
society of the quiet laboratory worker and the skillful propagandist 
and expressed his opinion by describing a hypothetical situation: if 
these two men were drowning and only one life preserver were avail¬ 
able, he would throw it to Pavlov. 

Evidently Shaw was not pleased, and, after what appears to have 
been a hasty glance at Pavlov’s work, retaliated. His book. The Ad- 
ventures of the Black Girl in Her Search for God, describes a girl’s 
experiences in a jungle of ideas. The jungle is inhabited by many 
prophets, some of them ancient and some as modern as an “elderly 
myop” who bears a close resemblance to Pavlov. Tlie black girl 
encounters Pavlov just after she has been frightened by a fearful 
roar from the prophet Micah. She pulls herself up in her flight and 
exclaims: 

‘\\'Tiat am 1 running away from? I’m not afraid of that dear noisy old 
man.” 

“Your fears and hopes arc only fancies” said a voice close to her, pro¬ 
ceeding from a very shortsighted elderly man in spectacles who was sitting 
on a gnarled log. “In running away you were acting on a conditioned 
reflex. It is quite simple. Having lived among lions you have from your 
childhood associated the sound of a roar with deadly danger. Hence your 
precipitate flight when that superstitious old jackass brayed at you. This 
remarkable discovery cost me bventy-five years of devoted research, dur¬ 
ing which I cut out the brains of innumerable dogs, and observed their 
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spittle by making holes in their cheeks for them to salivate through in¬ 
stead of through their tongues. Tlic whole scientific world is prostrate 
at my feet in admiration of this colossal achievement and gratitude for 
the light it has shed on the great problems of human conduct." 

"Why didn’t you ask me?" said the black girl. “1 could have told you 
in twenty-five seconds without hurting those poor dogs.” 

"Your ignorance and presumption arc unspeakable” said the old myop. 
"Tlie fact was known of course to ever)' child; but it had never been 
proved experimentally in the laboratory; and therefore it was not scien¬ 
tifically known at all. It reached me as an unskilled conjecture: I handed 
it on as science. Have you ever performed an experiment, may 1 ask?” 

"Several” said the black girl. "I will perform one now. Do you know 
what you arc sitting on?” 

"I am sitting on a log grey with age, and covered with an uncomfor¬ 
table rugged bark” said the myop. 

“You arc mistaken” said the black girl. “You are sitting on a sleeping 
crocodile.” 

With a yell which Micah himself might have envied, the myop rose 
and fled frantically to a neighboring tree, up which he climbed catlike 
with an agility which in so elderly a gentleman was quite superhuman. 

"Come down” said the black girl. "You ought to know that crocodiles 
arc only to be found near rivers. I was only trying an experiment. Come 
down.” 

But the elderly myop is unable to come down and begs the girl to 
perform another experiment. 

"I will" said the black girl. “There is a tree snake smelling at the back 
of your neck.” 

The myop was on the ground in a jiffy.* 

It is clear that Shaw has caught the spirit of a science of behavior. 
The black girl is undeniably a good behavioral engineer. In two very 
neat examples of stimulus control she induces clearcut responses in 
the elderly myop. (His behavior does not, as we shall see later, exem¬ 
plify the simple reflex, conditioned or otherwise.) But if the author 
is fully aware of the potentialities of the practical control of be¬ 
havior, he is not so strong on theory, for the passage exemplifies a 
common misunderstanding regarding the achievement of science. 

‘ George Bernard Shaw, The Adventures of the Black Girl in Her Search for 
God, copyright, 1933, by George Bernard Shaw, and used by permission of the 
Public Trustee and the Society of Authors. 
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The facts of science are seldom entirely unknown “to every child/" 
A child who can catch a ball knows a good deal about trajectories. 
It may take science a long time to calculate the position of a ball at 
a given moment any more exactly than the child must “calculate” 
it in order to catch it. When Count Rumford» while boring cannon 
in the militaiy' arsenal in Munich, demonstrated that he could pro¬ 
duce any desired amount of heat without combustion, he changed 
the course of scientific thinking about the causes of heat; but he had 
discoN'crcd nothing which was not already known to the savage who 
kindles a fire with a spinning stick or the man who warms his hands 
on a frosty morning by nibbing them together vigorously. 

The difference between an unskilled conjecture and a scientific 
fact is not simply a difference in evidence. It had long been known 
that a child might cry- before it was hurt or that a fox might salivate 
upon seeing a bunch of grapes. What Pavlov added can be under¬ 
stood most clearly by considering his history. Originally he was inter¬ 
ested in the process of digestion, and he studied the conditions under 
which digestive juices were secreted. Various chemical substances in 
the mouth or in the stomach resulted in the reflex action of the 
digestive glands. Pavlov’s work was sufficiently outstanding to receive 
the Nobel Prize, but it was by no means complete. He was handi¬ 
capped by a certain unexplained secretion. Although food in the 
mouth might elicit a flow of saliva, saliva often flowed abundantly 
when the mouth was empty. We should not be surprised to learn 
that this was called “psychic secretion.” It was explained in terms 
which “any child could understand.” Perhaps the dog was “thinking 
about food.” Perhaps the sight of the experimenter preparing for the 
next experiment “reminded” the dog of the food it had received in 
earlier experiments. But these explanations did nothing to bring the 
unpredictable salivation within the compass of a rigorous account of 
digestion. 

Pavlov’s first step was to control conditions so that “psychic secre¬ 
tion” largely disappeared. He designed a room in which contact 
between dog and experimenter was reduced to a minimum. The 
room was made as free as possible from incidental stimuli. The dog 
could not hear the sound of footsteps in neighboring rooms or smell 
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accidental odors in the ventilating system. Pavlov then built up a 
“psychic secretion” step by step. In place of the complicated stim¬ 
ulus of an experimenter preparing a syringe or filling a dish with 
food, he introduced controllable stimuli which could be easily de¬ 
scribed in physical terms. In place of the accidental occasions upon 
which stimulation might precede or accompany food, Pavlov arranged 
precise schedules in which controllable stimuli and food were pre¬ 
sented in certain orders. Without influencing the dog in any other 
way. he could sound a tone and insert food into the dog’s mouth. 
In this way he was able to show that the tone acquired its ability to 
elicit secretion, and he was also able to follow the process through 
which this came about. Once in possession of these facts, he could 
then give a satisfactory' account of all secretion. He had replaced the 
“psyche” of psychic secretion with certain objective facts in the recent 
history of the organism. 

The process of conditioning, as Pavlov reported it in his book 
Conditioned Reflexes, is a process of stimulus substitution. A pre¬ 
viously neutral stimulus acquires the power to elicit a response which 
was originally elicited by another stimulus. The change occurs when 

the neutral stimulus is followed or “reinforced” bv the effective 

# 

stimulus. Pavlov studied the effect of the inter^'al of time elapsing 
between stimulus and reinforcement. He investigated the extent to 
which various properties of stimuli could acquire control. He also 
studied the converse process, in which the conditioned stimulus 
loses its power to evoke the response when it is no longer reinforced 
—a process which he called “extinction.” 

The quantitati\ e properties which he discovered are by no means 
“known to every' child.” And they are important. The most efficient 
use of conditioned reflexes in the practical control of behavior often 
requires quantitative information. A satisfactory theory makes the 
same demands. In dispossessing explanatory' fictions, for example, we 
cannot be sure that an event of the sort implied by “psy'chic secre¬ 
tion” is not occasionally responsible until we can predict the exact 
amount of secretion at any given time. Only a quantitative descrip¬ 
tion will make sure that there is no additional mental process in 
which the dog “associates the sound of the tone with the idea of 
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food” or in wliich it salivates because it “expects” food to appear. 
Pa\ lov could dispense with concepts of this sort only when he could 
give a complete quantitative account of salivation in terms of the 
stimulus, the response, and the historj' of conditioning. 

Pavlov, as a physiologist, was interested in how the stimulus was 
converted into neural processes and in how other processes carried 
the effect through the nervous system to the muscles and glands. The 
subtitle of his book is An Investigation of the Physiological Activity 
of the Cerebral Cortex. Tlie “physiological activity” was inferential. 
^Ve may suppose, howe\ er, that comparable processes will eventually 
be described in terms appropriate to neural events. Such a descrip¬ 
tion will fill in the temporal and spatial gaps between an earlier his- 
tory of conditioning and its current result. The additional account 
will be important in the integration of scientific knowledge but will 
not make the relation between stimulus and response any more law¬ 
ful or any more useful in prediction and control. Pavlov’s achieve¬ 
ment was the discovery, not of neural processes, but of important 
quantitative relations which permit us, regardless of neurological 
hypotheses, to give a direct account of behavior in the field of the 
conditioned reflex. 

HIE "SURVIVAL VALUE" OF REFLEXES 

Reflexes are intimately concerned with the well-being of the 
organism. The process of digestion could not go on if certain secre¬ 
tions did not begin to flow when certain types of food entered the 
stomach. Reflex behavior which involves the external environment is 
important in the same way. If a dog’s foot is injured when it steps on 
a sharp object, it is important that the leg should be flexed rapidly so 
that the foot is withdrawn. The so-called “flexion reflex” brings this 
about. Similarly, it is important that dust blown into the eye should 
be washed out by a profuse secretion of tears, that an object sud¬ 
denly moved toward the eyes should be warded off by blinking, and 
so on. Such biological advantages “explain” reflexes in an evolution¬ 
ary sense: individuals who are most likely to behave in these ways are 
presumably most likely to survive and to pass on the adaptive char¬ 
acteristic to their offspring. 
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The process of conditioning also has survival value. Since the 
environment changes from generation to generation, particularly the 
external rather than the internal environment, appropriate reflex 
responses cannot always develop as inherited mechanisms. Thus an 
organism may be prepared to secrete saliva when certain chemical 
substances stimulate its mouth, but it cannot gain the added advan¬ 
tage of salivating before food is actually tasted unless the physical 
appearance of foodstuffs remains the same from environment to 
environment and from time to time. Since nature cannot foresee, so 
to speak, that an object with a particular appearance will be edible, 
the evolutionary process can only provide a mechanism by which 
the individual will acquire responses to particular features of a given 
environment after they have been encountered. Where inherited 
behaviour leaves off, the inherited modifiability of the process of con¬ 
ditioning takes over. 

It does not follow that every conditioned reflex has survival value. 
The mechanism may go wrong. Certain pairs of stimuli, such as the 
appearance and taste of food, may occur together in a consistent way 
which is important to the organism throughout its life, but we have 
no guarantee that conditioning will not occur when the pairing of 
stimuli is temporary or accidental. Many “superstitions” exemplify 
conditioned responses arising from accidental contingencies. Tlie 
behavior is due to an actual pairing of stimuli, but the resulting 
conditioned reflex is not useful. We call some such reflexes “irra¬ 
tional.” A child who has been attacked by a dog may fear all dogs. 
The visual stimulus supplied by a dog has been paired with the terri- 
f)'ing stimulation of physical attack. But the pairing is not inevitable 
for all dogs. When the response is later elicited at the sight of a harm¬ 
less dog, it serves no useful function. It is, nevertheless, due to a 
process which does prove valuable elsewhere. We all suffer from this 
miscarriage of the evolutionarj^ process when we make stereotyped 
responses. Strong behavior appropriate to the sight of someone we 
dislike violently may be evoked by other people with the same fea¬ 
tures, wearing the same type of clothes, and so on. Minor effects of 
the same sort are less troublesome. A nostalgic reaction to a tune 
which was popular during an old love affair is a conditioned response 
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arising from a nonfunctional pairing of stimuli, but we do not call it 
superstitious or irrational. 

I HE RANGE OF CONDl'I lONED REFLEXES 

Although the process of conditioning greatly extends the scope of 
the eliciting stimulus, it does not bring all the behavior of the or¬ 
ganism within such stimulus control. According to the formula of 
stimulus substitution we must elicit a response before we can condi¬ 
tion it. All conditioned reflexes are, therefore, based upon uncondi¬ 
tioned reflexes. But we have seen that reflex responses are only a small 
part of the total behavior of the organism. Conditioning adds new 
controlling stimuli, but not new responses. In using the principle, 
therefore, we are not subscribing to a “conditioned-reflex theory” of 
all behavior. 

A fair measure of the range of the conditioned reflex is its use in 
the practical control of behavior. Reflexes which are concerned with 
the internal economy of the organism are seldom of practical impor¬ 
tance to other people, but an occasion may arise when we are inter¬ 
ested in making someone blush or laugh or cry, and we then resort 
to conditioned or unconditioned stimuli. It is frequently the business 
of literature to generate behavior in this way. The “tear-jerker” has a 
literal meaning. More subtle effects are similar: it is important in 
understanding the effect of a poem to note that conditioned responses 
may be elicited by such verbal stimuli as “death,” “love,” “sorrow,” 
and so on, quite apart from the effect of the prose meaning of the 
poem. The emotional effects of music and painting are largely con¬ 
ditioned. 

We also use this process to arrange for the control of behavior at 
a later date. In patriotic and religious education, for example, emo¬ 
tional responses to flags, insignia, symbols, and rituals are conditioned 
so that these stimuli will be effective upon future occasions. A com¬ 
monly proposed “cure” for excesshe drinking or smoking consists of 
adding substances to liquor or tobacco which generate nausea, head¬ 
aches, and so on. W^hen liquor or tobacco are later seen or tasted, 
similar responses are evoked as the result of conditioning. They may 
compete with the behavior of drinking or smoking—as by “taking all 
the fun out of it.” Conditioning of this sort is treating a symptom 
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rather than a cause, but it may make it easier for the patient to stop 
drinking or smoking for other reasons. 

Training a soldier consists in part of conditioning emotional re¬ 
sponses. If pictures of the enemy, the enemy’s flag, and so on arc 
paired with stories or pictures of atrocities, a suitable aggressive reac¬ 
tion will probably occur at the sight of the enemy. Favorable reactions 
are generated in somewhat the same way. Responses to delectable 
foods are easily transferred to other objects. Just as we “dislike” the 
liquor or tobacco which makes us ill, so we “like” stimuli which 
accompany delicious food. I’he successful salesman is likely to buy 
his customer a drink or take him out to dinner. The salesman is not 
interested in gastric reactions but in the customer’s predisposition 
to act favorably toward him and his product which, as wc shall see 
later, also follows from the pairing of stimuli. The free lunch at a 
political rally has a similar effect. So has the stick of gum which the 
pediatrician gives his young patient. It has been shown experimentally 
that people come to “like” modern music if they listen to it while 
eating. When the Jewish child first learns to read, he kisses a page 
upon which a drop of honey has been placed. The important thing is 
not that he will later salivate at the sight of a book, but that he will 
exhibit a predisposition “in favor of” books. ITie reinforcements 
which establish predispositions of this sort are not all gastric. As 
advertisers well know, the responses and attitudes evoked by prett)' 
girls, babies, and pleasant scenes may be transferred to trade names, 
products, pictures of products, and so on. 

We are sometimes interested in generating one emotional response 
in order to counteract or balance another. Tlie dentist, for example, 
faces a practical problem in that he must administer painful stimuli. 
These stand in such relation to the stimuli supplied by the waiting 
room, the dental chair, the instruments, and the sound of the drill 
that eventually the latter evoke a variety of emotional reactions. 
Some of these we characterize roughly as anxiety. A funny picture- 
book in the waiting room may elicit responses which are incompatible 
with anxiety and which to some extent cancel it. This momentary 
effect exemplifies the use of stimuli which have already been condi¬ 
tioned. The “educational” effect of such a book in creating a less 
unfavorable attitude toward the dentist exemplifies the use of condi- 
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tioning in the control of behavior. The flowers and music in “funeral 
homes" have an immediate effect in counteracting the reactions 
evoked by a dead body, and through the process of conditioning they 
create a more favorable predisposition in the future toward burial 
practices. 

Eliminating a conditioned response is also a common practical 
problem. For example, we may want to reduce the fear reactions 
which have come to be evoked by people, animals, air raids, or 
military combat. Following the procedures in the conditioned-reflex 
experiment, we present a conditioned stimulus while omitting the 
reinforcing stimulus responsible for its effect. A major step in the 
treatment of stuttering, for example, is to extinguish reactions of 
anxiety or embarrassment generated by thoughtless persons who have 
laughed at the stutterer or grown impatient with him. A common 
technique is to encourage him to talk to anyone he encounters. 
Functional responses of anxiety and embarrassment are generally con¬ 
ditioned in early childhood. If the adult stutterer is no longer laughed 
at, the responses may undergo extinction. The therapy consists 
simply of encouraging the stutterer to talk so that the conditioned 
stimuli thus automatically generated may occur without reinforce¬ 
ment. 

If the conditioned stimulus elicits too strong a response, it may 
be necessaiy' to present it in graded doses. If a child who has been 
frightened by a dog is given a small puppy, the similarity between 
the puppy and the frightening dog is not great enough to elieit a 
strong conditioned fear response. Any slight response which happens 
to appear undergoes extinction. As the puppy grows to resemble the 
dog, extinction proceeds by easy stages. A similar technique is some¬ 
times used in reducing excessive emotional reactions to air raids, 
combat, and similar traumatic conditions. Extinction is brought 
about with stimuli which are at first only slightly disturbing—vague 
noises, faint sirens, or distant sounds of bursting shells. Visual stimuli 
are presented without their auditory accompaniments in silent mov¬ 
ing pictures of actual combat. As extinction occurs, the verisimilitude 
is increased. Eventually, if the treatment is successful, little or no 
response is elicited by a full-scale stimulus. 



CHAPTER Y 


OPERANT BEHAVIOR 


THE CONSEQUENCES OF BEHAVIOR 

Reflexes, conditioned or otherwise, are mainly concerned 
with the internal physiology' of the organism. We are most often 
interested, however, in behavior which has some effect upon the 
surrounding world. Such behavior raises most of the practical prob¬ 
lems in human affairs and is also of particular theoretical interest 
because of its special characteristics. The consequences of behavior 
may “feed back” into the organism. When they do so, they may 
change the probability that the behavior which produced them will 
occur again. The English language contains many words, such as 
“reward” and “punishment,” which refer to this effect, but we can 
get a clear picture of it only through experimental analysis. 

LEARNING CURVES 

One of the first serious attempts to study the changes brought 
about by the consequences of behavior was made by E. L. Thorn¬ 
dike in 1898. His experiments arose from a controversy which was 
then of considerable interest. Darwin, in insisting upon the con¬ 
tinuity of species, had questioned the belief that man was unique 
among the animals in his ability to think. Anecdotes in which lower 
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animals seemed to show the “power of reasoning" were published in 
great numbers. But when terms which had formerly been applied 
onlv to human behavior were thus extended^ certain questions arose 
concerning their meaning. Did the observed facts point to mental 
processes, or could these apparent evidences of thinking be explained 
in other ways? Eventually it became clear that the assumption of 
inner thought-processes was not required. Many years were to pass 
before the same question was seriously raised concerning human 
behavior, but Thorndike’s experiments and his alternative explana¬ 
tion of reasoning in animals were important steps in that direction. 

If a cat is placed in a box from which it can escape only by unlatch 
ing a door, it will exhibit many different kinds of behavior, some of 
which may be effective in opening the door. Thorndike found that 
when a cat was put into such a box again and again, the behavior 
which led to escape tended to occur sooner and sooner until even¬ 
tually escape was as simple and quick as p'ossible. The cat had solved 
its problem as well as if it were a “reasoning” human being, though 
perhaps not so speedily. Yet Thorndike observed no “thought-proc¬ 
ess” and argued that none was needed by way of explanation. He 
could describe his results simply by saying that a part of the cat’s 
behavior was “stamped in” because it was followed by the opening of 
the door. 

Tlie fact that behavior is stamped in when followed by certain con¬ 
sequences, Thorndike called “The Law of Effect.” What he had 
observed was that certain behavior occurred more and more readily 
in comparison with other behavior characteristic of the same situa¬ 
tion. By noting the successive delays in getting out of the box and 
plotting them on a graph, he constructed a “learning curve.” This 
early attempt to show a quantitative process in behavior, similar to 
the processes of physics and biology, was heralded as an important 
advance. It revealed a process which took place over a considerable 
period of time and which was not obvious to casual inspection. 
Thorndike, in short, had made a discovery. Many similar curves have 
since been recorded and have become the substance of chapters on 
learning in psychology texts. 

Learning curves do not, however, describe the basic process of 
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stamping in. Tliorndike’s measure—the time taken to escape— 
involved the elimination of other behavior, and his curve depended 
upon the number of different things a cat might do in a particular 
box. It also depended upon the beha\ ior which the experimenter or 
the apparatus happened to select as “successful” and upon whether 
this was common or rare in comparison with other behavior evoked 
in the box. A learning cur\e obtained in this way might be said to 
reflect the properties of the latch box rather than of the behavior of 
the cat. The same is true of many other devices developed for the 
study of learning, llie various mazes through which white rats and 
other animals learn to run, the “choice boxes” in which animals 
learn to discriminate between properties or patterns of stimuli, the 
apparatuses which present sequences of material to be learned in 
the study of human memory—each of these yields its own hpe of 
learning cim'e. 

By averaging many individual cases, we may make these cim’es as 
smooth as we like. Moreover, cim'es obtained under many different 
circumstances may agree in showing certain general properties. Kor 
example, when measured in this way, learning is generally “negatively 
accelerated”—improvement in performance occurs more and more 
slowly as the condition is approached in which further improvement 
is impossible. But it does not follow that negative acceleration is 
characteristic of the basic process. Suppose, by analog)', we fill a glass 
jar with gravel which has been so well mixed that pieces of any given 
size are evenly distributed. We then agitate the jar gently and watch 
the pieces rearrange themselves. The larger move toward the top, 
the smaller toward the bottom. This process, too, is negatively acceler¬ 
ated. At first the mixture separates rapidly, but as separation pro¬ 
ceeds, the condition in which there will be no further change is 
approached more and more slowly. Such a curve may be quite smooth 
and reproducible, but this fact alone is not of any great significance. 
The curve is the result of certain fundamental processes involving 
the contact of spheres of different sizes, the resolution of the forces 
resulting from agitation, and so on, but it is by no means the most 
direct record of these processes. 

Learning curves show how the various kinds of behavior evoked 
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in complex situations are sorted out, emphasized, and reordered. 
The basic process of the stamping in of a single act brings this change 
about, but it is not reported directly by the change itself. 

OPERANT CONDITIONING 

To get at the core of Thorndike’s Law of Effect, we need to 
clarify the notion of “probability of response.” This is an extremely 
important concept; unfortunately, it is also a difficult one. In dis¬ 
cussing human behavior, we often refer to “tendencies” or “predispo¬ 
sitions” to behave in particular ways. Almost every theory of behavior 
uses some such term as “excitatory potential,” “habit strength,” or 
“determining tendency.” But how do we observe a tendency? And 
how can we measure one? 

If a given sample of behavior existed in only two states, in one 
of which it always occurred and in the other never, we should be 
almost helpless in following a program of functional analysis. An 
all or-none subject matter lends itself only to primitive forms of 
description. It is a great advantage to suppose instead that the 
probability that a response will occur ranges continuously between 
these all or-none extremes. We can then deal with variables which, 
unlike the eliciting stimulus, do not “cause a given bit of behavior to 
occur” but simply make the occurrence more probable. We may then 
proceed to deal, for example, with the combined effect of more than 
one such variable. 

The ever}'day expressions which carry the notion of probability, 
tendency, or predisposition describe the frequencies with which bits 
of behavior occur. We never observe a probability Us such. We say 
that someone is “enthusiastic” about bridge when we observe that 
he plays bridge often and talks about it often. To be “greatly inter¬ 
ested” in music is to play, listen to, and talk about music a good deal. 
The “inveterate” gambler is one who gambles frequently. The camera 
“fan” is to be found taking pictures, developing them, and looking 
at pictures made by himself and others. The “highly sexed” person 
frequently engages in sexual behavior. The “dipsomaniac” drinks 
frequently. 

In characterizing a man’s behavior in terms of frequency, we 
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assume certain standard conditions: he must be able to execute and 
repeat a given act, and other behavior must not interfere appreciably. 
We cannot be sure of the extent of a man’s interest in music, for 
example, if he is necessarily busy with other things. When we come 
to refine the notion of probability of response for scientific use, wc 
find that here, too, our data are frequencies and that the conditions 
under which they arc obsciAcd must be specified, llie main technical 
problem in designing a controlled experiment is to provide for the 
observation and interpretation of frequencies. We eliminate, or at 
least hold constant, any condition which encourages behavior which 
competes with the behavior we are to study. An organism is placed 
in a quiet box where its behavior may be obser\’ed through a one-way 
screen or recorded mechanically. This is by no means an environ¬ 
mental vacuum, for the organism will react to the features of the box 
in many ways; but its behavior will eventually reach a fairly stable 
level, against which the frequency of a selected response may be 
investigated. 

To study the process which Tliomdike called stamping in, we must 
have a “consequence.” Giving food to a hungr)' organism will do. 
We can feed our subject conveniently with a small food tray which 
is operated electrically. When the tray is first opened, the organism 
will probably react to it in ways which interfere with the process we 
plan to observe. Eventually, after being fed from the tray repeatedly, 
it eats readily^ and we are then ready to make this consequence con¬ 
tingent upon behavior and to obseiT'e the result. 

We select a relatively simple bit of behavior which may be freely 
and rapidly repeated, and which is easily observed and recorded. If 
our experimental subject is a pigeon, for example, the behavior of 
raising the head above a given height is convenient. This may be 
obseiA'ed by sighting across the pigeon’s head at a scale pinned on the 
far wall of the box. We first study the height at which the head is 
normally held and select some line on the scale which is reached 
only infrequently. Keeping our eye on the scale we then begin to 
open the food tray very quickly whenever the head rises above the 
line. If the experiment is conducted according to specifications, the 
result is invariable: we observe an immediate change in the frequency 
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with which the head crosses the line. We also observe, and this is 
of some importance theoretically, that higher lines are now being 
crossed. We may advance almost immediately to a higher line in 
determining when food is to be presented. In a minute or two, the 
bird’s posture has changed so that the top of the head seldom falls 
below the line which we first chose. 

When we demonstrate the process of stamping in in this relatively 
simple way, we see that certain common interpretations of Thorn¬ 
dike’s experiment arc superfluous. The expression “trial-and-error 
learning,” which is frequently associated with the Law of Effect, is 
clearly out of place here. We are reading something into our observa¬ 
tions when we call any upward movement of the head a “trial,” and 
there is no reason to call anv movement which does not achieve a 
specified consequence an “error.” Even the term “learning” is mis¬ 
leading. The statement that the bird “learns that it will get food by 
stretching its neck” is an inaccurate report of what has happened. 
To say that it has acquired the “habit” of stretching its neck is merely 
to resort to an explanatory fiction, since our only evidence of the 
habit is the acquired tendency to perform the act. The barest pos¬ 
sible statement of the process is this: we make a given consequence 
contingent upon certain physical properties of behavior (the upward 
movement of the head), and the behavior is then observed to in¬ 
crease in frequency. 

It is customary' to refer to any movement of the organism as a 
“response.” The word is borrowed from the field of reflex action and 
implies an act which, so to speak, answers a prior event—the stimulus. 
But we may make an event contingent upon behavior without identi¬ 
fying, or being able to identify', a prior stimulus. We did not alter 
the environment of the pigeon to elicit the upward movement of the 
head. It is probably impossible to show that any single stimulus 
invariably precedes this movement. Behavior of this sort may come 
under the control of stimuli, but the relation is not that of elicitation. 
The term “response” is therefore not wholly appropriate but is so 
well established that we shall use it in the following discussion. 

A response which has already occurred cannot, of course, be pre¬ 
dicted or controlled. We can only predict that similaT responses will 
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occur in the future. The unit of a predictive science is, therefore, not 
a response but a class of responses. I'he word “operant” will be used 
to describe this class. The term emphasizes the fact that the behavior 
operates upon the environment to generate consequences. The con¬ 
sequences define the properties with respect to which responses are 
called similar. The term will be used both as an adjective (operant 
behavior) and as a noun to designate the behavior defined by a 
given consequence. 

A single instance in which a pigeon raises its head is a response. 
It is a bit of histon- which may be reported in any frame of reference 
we wish to use. The behavior called “raising the head,” regardless 
of when specific instances occur, is an operant. It can be described, 
not as an accomplished act. but rather as a set of acts defined by the 
propertv of the height to which the head is raised. In this sense an 
operant is defined by an effect which may be specified in physical 
terms; the “cutoff” at a certain height is a property of behavior. 

The term “learning” may profitably be saved in its traditional 
sense to describe the reassortment of responses in a complex situa¬ 
tion. Terms for the process of stamping in may be borrowed from 
Pavlov’s analysis of the conditioned reflex. Pavlov himself called all 
events which strengthened behavior “reinforcement” and all the 
resulting changes “conditioning.” In the Pavlovian experiment, how¬ 
ever, a reinforcer is paired with a stimulus; whereas in operant be¬ 
havior it is contingent upon a response. Operant reinforcement is 
therefore a separate process and requires a separate analysis. In both 
cases, the strengthening of behavior which results from reinforcement 
is appropriately called “conditioning.” In operant conditioning we 
"strengthen” an operant in the sense of making a response more 
probable or, in actual fact, more frequent. In Pavlovian or “re¬ 
spondent" conditioning we simply increase the magnitude of the 
response elicited by the conditioned stimulus and shorten the time 
which elapses between stimulus and response. (We note, incidentally, 
that these two cases exhaust the possibilities: an organism is condi¬ 
tioned when a reinforcer [1] accompanies another stimulus or [2] 
follows upon the organism’s own behavior. Any event which does 
neither has no effect in changing a probability of response.) In the 
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pigeon experiment, then, food is the reinforcer and presenting food 
when a response is emitted is the reinforcement. The operant is 
defined by the property upon which reinforcement is contingent— 
the height to which the head must be raised. The change in fre¬ 
quency with which the head is lifted to this height is the process of 
operant conditioning. 

While we are awake, we act upon the environment constantly, and 
many of the consequences of our actions are reinforcing. Through 
operant conditioning the environment builds the basic repertoire with 
which we keep our balance, walk, play games, handle instruments 
and tools, talk, write, sail a boat, drive a car, or fly a plane. A change 
in the environment—a new car, a new friend, a new field of interest, 
a new job, a new location—may find us unprepared, but our behavior 
usually adjusts quickly as we acquire new responses and discard old. 
We shall see in the following chapter that operant reinforcement 
docs more than build a behavioral repertoire. It improves the eflfi- 
ciency of behavior and maintains behavior in strength long after 
acquisition or efficiency has ceased to be of interest. 

QUAmiT.Vn\'E PROPERTIES 

It is not easy to obtain a curv^e for operant conditioning. We can- 
not isolate an operant completely, nor can we eliminate all arbitrary 
details. In our example we might plot a curve showing how the fre¬ 
quency with which the pigeon’s head is lifted to a given height 
changes with time or the number of reinforcements, but the total 
effect is clearly broader than this. There is a shift in a larger pattern 
of behavior, and to describe it fully we should have to follow all 
movements of the head. Even so, our account would not be complete. 
The height to which the head was to be lifted was chosen arbitrarily, 
and the effect of reinforcement depends upon this selection. If we 
reinforce a height which is seldom reached, the change in pattern will 
be far greater than if we had chosen a commoner height. For an 
adequate account we need a set of curves covering all the possibilities. 
Still another arbitrary element appears if we force the head to a 
higher and higher position, since we may follow different schedules 
in advancing the line selected for reinforcement. Each schedule will 
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yield its own curve, and the picture would be complete only if it 
covered all possible schedules. 

We cannot avoid these problems by selecting a response which is 
more sharply defined bv features of the environment—for example, 
the behavior of operating a door latch. Some mechanical indicator 
of behavior is, of course, an advantage—for example, in helping us 
to reinforce consistently. We could record the height of a pigeon s 
head with a photocell arrangement, but it is simpler to select a 
response which makes a more easily recorded change in the environ¬ 
ment. If the bird is conditioned to peck a small disk on the wall of 
the experimental box, we may use the movement of the disk to close 
an electric circuit—both to operate the food tray and to count or 
record responses. Such a response seems to be different from stretch¬ 
ing the neck in that it has an all-or-none character. But we shall see 
in a moment that the mechanical features of striking a key do not 
define a "response’' which is any less arbitrary than neck-stretching. 

An experimental arrangement need not be perfect in order to pro¬ 
vide important quantitative data in operant conditioning. Wc are 
already in a position to evaluate many factors. The importance of 
feed-back is clear. The organism must be stimulated by the conse¬ 
quences of its behavior if conditioning is to take place. In learning 
to wiggle one’s ears, for example, it is necessary to know when the 
ears move if responses which produce movement are to be strength¬ 
ened in comparison with responses which do not. In re-educating 
the patient in the use of a partially paralyzed limb, it may be of help 
to amplify the feed-back from slight movements, either with instru¬ 
ments or through the report of an instructor. The deaf-mute learns 
to talk only when he receives a feed-back from his own behavior 
which can be compared with the stimulation he receives from other 
speakers. One function of the educator is to supply arbitrary (some¬ 
times spurious) consequences for the sake of feed-back. Conditioning 
depends also upon the kind, amount, and immediacy of reinforce¬ 
ment, as well as many other factors. 

A single reinforcement may have a considerable effect. Under good 
conditions the frequency of a response shifts from a prevailing low 
value to a stable high value in a single abrupt step. More commonly 
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\vc obscn'c a substantial increase as the result of a single reinforce¬ 
ment, and additional increases from later reinforcements. The obser¬ 
vation is not incompatible with the assumption of an instantaneous 
change to a maximal probability, since we have by no means isolated 
a single operant. The increased frequency must be interpreted with 
respect to other behavior characteristic of the situation. The fact that 
conditioning can be so rapid in an organism as “low” as the rat or 
pigeon has interesting implications. Differences in what is commonly 
called intelligence are attributed in part to differences in speed of 
learning. But there can be no faster learning than an instantaneous 
increase in probability of response. The superiority of human be¬ 
havior is, therefore, of some other sort. 

THE CONTROL OF OPERANT BEHAVIOR 

The experimental procedure in operant conditioning is straight¬ 
forward. We arrange a contingency of reinforcement and exp>ose an 
organism to it for a given period. We then explain the frequent emis¬ 
sion of the response by pointing to this history. But what improve¬ 
ment has been made in the prediction and control of the behavior 
in the future? What variables enable us to predict whether or not 
the organism will respond? What variables must we now control in 
order to induce it to respond? 

We have been experimenting with a hungry pigeon. As we shall 
see in Chapter IX, this means a pigeon which has been deprived of 
food for a certain length of time or until its usual body-weight has 
been slightly reduced. Contrary to what one might expect, experi¬ 
mental studies have shown that the magnitude of the reinforcing 
effect of food may not depend upon the degree of such deprivation. 
But the frequency of response which results from reinforcement de¬ 
pends upon the degree of deprivation at the time the response is 
observed. Even though we have conditioned a pigeon to stretch its 
neck, it does not do this if it is not hungry. We have, therefore, a 
new sort of control over its behavior: in order to get the pigeon to 
stretch its neck, we simply make it hungry. A selected operant has 
been added to all those things which a hungry pigeon will do. Our 
control over the response has been pooled with our control over food 
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deprivation. Wc shall see in Chapter that an operant may also 
come under the control of an external stimulus, which is another 
variable to be used in predicting and controlling the behavior. We 
should note, however, that both these variables arc to be distinguished 
from operant reinforcement itself. 

OPERANT EXTINCl’ION 

When reinforcement is no longer forthcoming, a response be¬ 
comes less and less frequent in what is called “operant extinction." 
If food is withheld, the pigeon will eventually stop lifting its head. 
In general when we engage in behavior which no longer “pa\s off," 
we find ourselves less inclined to behave in that way again. If we 
lose a fountain pen, we reach less and less often into the pocket 
which formerly held it. If we get no answer to telephone calls, we 
eventually stop telephoning. If our piano goes out of tunc, wc 
gradually play it less and less. If our radio becomes noisy or if pro¬ 
grams become worse, wc stop listening. 

Since operant extinction takes place much more slowly than oper¬ 
ant conditioning, the process may be followed more easily. Under 
suitable conditions smooth cur\’es are obtained in which the rate of 
response is seen to decline slowly, perhaps over a period of many 
hours. The curves reveal properties which could not possibly be 
obseiA'ed through casual inspection. We may “get the impression” 
that an organism is responding less and less often, but the orderliness 
of the change can be seen only when the behavior is recorded. The 
curves suggest that there is a fairly uniform process which determines 
the output of behavior during extinction. 

Under some circumstances the curve is disturbed by an emotional 
effect. The failure of a response to be reinforced leads not only to 
operant extinction but also to a reaction commonly spoken of as 
frustration or rage. A pigeon which has failed to receive reinforce¬ 
ment turns away from the key, cooing, flapping its wings, and engag¬ 
ing in other emotional behavior (Chapter X). The human organism 
shows a similar double effect. The child whose tricycle no longer 
responds to pedaling not only stops pedaling but engages in a possibly 
violent emotional display. The adult who finds a desk drawer stuck 
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may soon stop pulling, but he may also pound the desk, exclaim 
“Damn it!,*’ or exhibit other signs of rage. Just as the child even¬ 
tually goes back to the tricvcle, and the adult to the drawer, so the 
pigeon will turn again to the key when the emotional response has 
subsided. As other responses go unreinforced, another emotional 
episode may ensue. Extinction cuia'CS under such circumstances show 
a cyclic oscillation as the emotional response builds up, disappears, 
and builds up again. If we eliminate the emotion by repeated ex¬ 
posure to extinction, or in other ways, the curve emerges in a simpler 
form. 

Behavior during extinction is the result of the conditioning which 
has preceded it, and in this sense the extinction curve gives an addi¬ 
tional measure of the effect of reinforcement. If only a few responses 
have been reinforced, extinction occurs quickly. A long history of 
reinforcement is followed by protracted responding. The resistance 
to extinction cannot be predicted from the probability of response 
observed at any given moment. We must know the history of rein¬ 
forcement. For example, though we have been reinforced with an 
excellent meal in a new restaurant, a bad meal may reduce our 
patronage to zero; but if we have found excellent food in a restaur¬ 
ant for many years, several poor meals must be eaten there, other 
things being equal, before we lose the inclination to patronize it 
again. 

There is no simple relation beh^’een the number of responses rein¬ 
forced and the number which appear in extinction. As we shall see in 
Chapter VI, the resistance to extinction generated by intermittent 
reinforcement may be much greater than if the same number of 
reinforcements are given for consecutive responses. Thus if we only 
occasionally reinforce a child for good behavior, the behavior survives 
after we discontinue reinforcement much longer than if we had 
reinforced ever}' instance up to the same total number of reinforce¬ 
ments. This is of practical importance where the available reinforcers 
are limited. Problems of this sort arise in education, industry, eco¬ 
nomics, and many other fields. Under some schedules of intermittent 
reinforcement as many as 10,000 responses may appear in the be¬ 
havior of a pigeon before extinction is substantially complete. 
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Extinction is an effective way of removing an operant from the 
repertoire of an organism. It should not be confused with other 
procedures designed to have the same effect. I'he currently preferred 
technique is punishment, which, as we shall see in Chapter XII, 
involves different processes and is of questionable effectiveness. For¬ 
getting is frequently confused with extinction. In forgetting, the 
effect of conditioning is lost simply as time passes, whereas extinction 
requires that the response be emitted without reinforcement. Usually 
forgetting does not take place quickly; sizeable extinction curves have 
been obtained from pigeons as long as six years after the response 
had last been reinforced. Six vears is about half the normal life span 
of the pigeon. During the interval the pigeons lived under circum¬ 
stances in which the response could not possibly have been rein¬ 
forced. In human behavior skilled responses generated by relatively 
precise contingencies frequently surv'ive unused for as much as half 
a lifetime. Tlie assertion that early experiences determine the per¬ 
sonality of the mature organism assumes that the effect of operant 
reinforcement is long-lasting. Thus if, because of early childhood 
experiences, a man marries a woman who resembles his mother, the 
effect of certain reinforcements must have sur\'ived for a long time. 
Most cases of forgetting involve operant behavior under the control 
of specific stimuli and cannot be discussed adequately until that con¬ 
trol has been covered in Chapter VII. 

The effects of extinction. The condition in which extinction is 
more or less complete is familiar, yet often misunderstood. Extreme 
extinction is sometimes called “abulia." To define this as a ' lack of 
will” is of little help, since the presence or absence of will is inferred 
from the presence or absence of the behavior. The term seems to be 
useful, however, in that it implies that the behavior is lacking for a 
special reason, and we may make the same distinction in another 
way. Behavior is strong or weak because of many different variables, 
which it is the task of a science of behavior to identify and classify. 
We define any given case in terms of the variable. Tlie condition 
which results from prolonged extinction superficially resembles inac¬ 
tivity resulting from other causes. The difference is in the history^ of 
the organism. An aspiring writer who has sent manuscript after 
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manuscript to the publishers only to have them all rejected may 
report that “he can’t write another word.” He may be partially para¬ 
lyzed with what is called “writer’s cramp.” He may still insist that 
he “wants to write,” and we may agree with him in paraphrase: his 
cxtrcmch low probability of response is mainly due to extinction. 
Other variables arc still operative which, if extinction had not taken 
place, would yield a high probability. 

'I hc condition of low operant strength resulting from extinction 
often requires treatment. Some forms of psychotherapy are systems of 
reinforcement designed to reinstate behavior which has been lost 
through extinction. Tlie therapist may himself supply the reinforce¬ 
ment, or he may arrange living conditions in which behavior is likely 
to be reinforced. In occupational therapy, for example, the patient 
is encouraged to engage in simple forms of behavior which receive 
immediate and fairly consistent reinforcement. It is of no advantage 
to say that such therapy helps the patient by giving him a “sense 
of achievement” or improves his “morale,” builds up his “interest,” 
or removes or prevents “discouragement.” Such terms as these merely 
add to the growing population of explanatory fictions. One who 
readily engages in a given activity is not showing an interest, he is 
showing the effect of reinforcement. We do not give a man a sense 
of achievement, we reinforce a particular action. To become dis¬ 
couraged is simply to fail to respond because reinforcement has not 
been forthcoming. Our problem is simply to account for probability 
of response in terms of a history of reinforcement and extinction. 

WHAT EVENTS ARE REINFORCING? 

In dealing with our fellow men in everyday life and in the clinic 
and laboratory, we may need to know just how reinforcing a specific 
event is. We often begin by noting the extent to which our own 
behavior is reinforced by the same event. This practice frequently 
miscarries; yet it is still commonly believed that reinforcers can be 
identified apart from their effects upon a particular organism. As the 
term is used here, however, the only defining characteristic of a rein¬ 
forcing stimulus is that it reinforces. 

The only way to tell whether or not a given event is reinforcing 
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to a given organism under given conditions is to make a direct test. 
We obser\’e the frequency of a selected response, then make an event 
contingent upon it and obser\’e any change in frequency. If there 
is a change, we classih' the event as reinforcing to the organism under 
the existing conditions. There is nothing circular about classifying 
events in terms of their effects; the criterion is both empirical and 
objective. It would be circular, however, if we then went on to assert 
that a given event strengthens an operant because it is reinforcing. 
We achieve a certain success in guessing at reinforcing powers only 
because we liave in a sense made a crude survey; we have gauged the 
reinforcing effect of a stimulus upon ourselves and assume the same 
effect upon others. We are successful only when we resemble the 
organism under study and when we have correctly surveyed our own 
behavior. 

Events which are found to be reinforcing are of two sorts. Some 
reinforcements consist of presenting stimuli, of adding something— 
for example, food, water, or sexual contact—to the situation. These 
we call positive reinforcers. Others consist of removing something— 
for example, a loud noise, a very bright light, extreme cold or heat, 
or electric shock—from the situation. These we call negative rein¬ 
forcers. In both cases the effect of reinforcement is the same—the 
probability of response is increased. We cannot avoid this distinction 
by arguing that what is reinforcing in the negative case is the absence 
of the bright light, loud noise, and so on; for it is absence after pres¬ 
ence which is effective, and this is only another way of saying that 
the stimulus is removed. The differenee between the two cases will 
be clearer when we consider the presentation of a negative reinforcer 
or the removal of a positive. These are the consequences which we 
call punishment (Chapter XII). 

A survey of the events which reinforce a given individual is often 
required in the practical application of operant conditioning. In every 
field in which human behavior figures prominently—education, gov¬ 
ernment, the family, the clinic, industry, art, literature, and so on— 
we are constantly changing probabilities of response by arranging 
reinforcing consequences. The industrialist who wants employees to 
work consistently and without absenteeism must make certain that 
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their behavior is suitably reinforced—not only with wages but with 
suitable working conditions. The girl who wants another date must 
be sure that her friend’s behavior in inviting her and in keeping the 
appointment is suitably reinforced. To teach a child to read or sing 
or play a game effectively, we must work out a program of educational 
reinforcement in which appropriate responses “pay off” frequently. If 
the patient is to return for further counsel, the psychotherapist must 
make sure that the behavior of coming to him is in some measure 
reinforced. 

We evaluate the strength of reinforcing events when we attempt 
to discover what someone is “getting out of life.” What conse¬ 
quences are responsible for his present repertoire and for the relative 
frequencies of the responses in it? His responses to various topics of 
conversation tell us something, but his everyday behavior is a better 
guide. We infer important reinforcers from nothing more unusual 
than his “interest” in a writer who deals with certain subjects, in 
stores or museums which exhibit certain objects, in friends who par¬ 
ticipate in certain kinds of behavior, in restaurants which serve certain 
kinds of food, and so on. The “interest” refers to the probability 
which results, at least in part, from the consequences of the behavior 
of “taking an interest.” We may be more nearly sure of the impor¬ 
tance of a reinforcer if we watch the behavior come and go as the 
reinforcer is alternately supplied and withheld, for the change in 
probability is then less likely to be due to an incidental change of 
some other sort. The behavior of associating with a particular friend 
varies as the friend varies in supplying reinforcement. If we observe 
this covariation, we may then be fairly sure of “what this friendship 
means” or “what our subject sees in his friend.” 

Tliis technique of evaluation may be improved for use in clinical 
and laboratory investigation. A direct inventory may be made by 
allowing a subject to look at an assortment of pictures and recording 
the time he spends on each. The behavior of looking at a picture is 
reinforced by what is seen in it. Looking at one picture may be more 
strongly reinforced than looking at another, and the times will vary 
accordingly. TTie information may be valuable if it is necessary for 
any reason to reinforce or extinguish our subject’s behavior. 
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Literature, art, and entertainment, are contrived reinforcers. 
Whether the publie buys books, tickets to performances, and works 
of art depends upon whether those books, plays, concerts, or pictures 
are reinforcing. Frequently the artist confines himself to an explora¬ 
tion of what is reinforcing to himself. When he does so his work 
“reflects his own individuality,” and it is then an accident (or a 
measure of his universality) if his book or play or piece of music or 
picture is reinforcing to others. Insofar as commercial success is im¬ 
portant, he may make a direct study of the behavior of others. (The 
interpretation of the activity of the writer and artist as an exploration 
of the reinforcing powers of certain media will be discussed in Chap¬ 
ter XVI.) 

We cannot dispense with this suiA’ey simply by asking a man what 
reinforces him. His reply may be of some value, but it is by no means 
necessarily reliable. A reinforcing connection need not be obvious to 
the individual reinforced. It is often only in retrospect that one’s 
tendencies to behave in particular ways are seen to be the result of 
certain consequences, and, as we shall see in Chapter XVIII, the rela¬ 
tion may never be seen at all even though it is obvious to others. 

There are, of course, extensive differences between individuals in 
the events which prove to be reinforcing. The differences between 
species are so great as scarcely to arouse interest; obviously what is 
reinforcing to a horse need not be reinforcing to a dog or man. Among 
the members of a species, the extensive differences are less likely to 
be due to hereditary endowment, and to that extent may be traced 
to circumstances in the histor)' of the individual. Tire fact that organ¬ 
isms evidently inherit the capacit)' to be reinforced by certain kinds 
of events does not help us in predicting the reinforcing effect of an 
untried stimulus. Nor does the relation between the reinforcing event 
and deprivation or any other condition of the organism endow the 
reinforcing event with any particular physical property. It is especially 
unlikely that events which have acquired their power to reinforce will 
be marked in any special way. Yet such events are an important 
species of reinforcer. 
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CONDITIONED REINFORCERS 

The stimulus which is presented in operant reinforcement may be 
paired with another in respondent conditioning. In Chapter IV, we 
considered the acquisition of the power to elicit a response; now we 
arc concerned witli the power to reinforce. Although reinforcement 
is a different stimulus function, the process resulting from the pairing 
of stimuli appears to be the same. If we have frequently presented 
a dish of food to a hungr\' organism, the empty dish will elicit saliva¬ 
tion. To some extent the empty dish will also reinforce an operant. 

We can demonstrate conditioned reinforcement more readily with 
stimuli which can be better controlled. If each time we turn on a 
light we gi\’e food to a hungr\' pigeon, the light eventually becomes 
a conditioned reinforcer. It may be used to condition an operant just 
as food is used. We know something about how the light acquires 
this property: the more often the light is paired with the food, the 
more reinforcing it becomes; the food must not follow the light by 
too great an interval of time; and the reinforcing power is rapidly 
lost when all food is withheld. We should expect all of this from our 
knowledge of stimulus conditioning. 

Conditioned reinforcers are often the product of natural con¬ 
tingencies. Usually, food and water are received only after the organ¬ 
ism has engaged in “precurrent” behavior—after it has operated upon 
the environment to create the opportunity for eating or drinking. 
The stimuli generated by this precurrent behavior, therefore, become 
reinforcing. Thus before we can transfer food from a plate to our 
mouth successfully, we must get near the plate, and any behavior 
which brings us near the plate is automatically reinforced. The pre- 
current behavior is, therefore, sustained in strength. This is important 
since only a small part of behavior is immediately reinforced with 
food, water, sexual contact, or other events of obvious biological 
importance. Although it is characteristic of human behavior that 
primary reinforcers may be effective after long delay, this is pre¬ 
sumably only because intervening events become conditioned rein- 
forcers. When a man puts storm windows on his house in October 
because similar behavior last October was followed by a warm house 
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in Januar)% we need to bridge the gap between the behavior in 
Oetober and the effeet in Januarv. Among the conditioned reinforcers 
responsible for the strength of this behavior are certain verbal conse¬ 
quences supplied by the man liimself or by his neighbors. It is often 
important to fill in a series of events between an act and an ultimate 
primary' reinforcement in order to control behavior for practical 
purposes. In education, industn,-, psychotherapy, and many other 
fields, we encounter techniques which are designed to create appro¬ 
priate conditioned rcinforcers. The effect of providing immediately 
effective consequences where ultimate consequences arc delayed is 
to “improve morale,” to “heighten interest,” to “prevent discourage¬ 
ment” or to correct the condition of low operant strength which we 
called abulia, and so on. More concretely, it is to induce students 
to study, employees to come to work, patients to engage in acceptable 
social behavior, and so on. 

Generalized rcinforcers. A conditioned reinforcer is generalized 
when it is paired with more than one primar)' reinforcer. Tlie gen¬ 
eralized reinforcer is useful because the momentan' condition of the 
organism is not likely to be important. The operant strength gener¬ 
ated by a single reinforcement is observed only under an appropriate 
condition of deprivation—when we reinforce with food, we gain 
control over the hungr)' man. But if a conditioned rcinforcer has 
been paired with reinforcers appropriate to many conditions, at least 
one appropriate state of deprivation is more likely to prevail upon a 
later occasion. A response is therefore more likely to occur. When we 
reinforce with money, for example, our subsequent control is rela¬ 
tively independent of momentar)' deprivations. One kind of general¬ 
ized reinforcer is created because many primar)' reinforcers are re¬ 
ceived only after the physical environment has been efficiently 
manipulated. One form of precurrent behavior may precede different 
kinds of reinforcers upon different occasions. The immediate stimula¬ 
tion from such behavior will thus become a generalized reinforcer. 
We are automatically reinforced, apart from any particular depriva¬ 
tion, when we successfully control the physical world. This may 
explain our tendency to engage in skilled crafts, in artistic creation, 
and in such sports as bowling, billiards, and tennis. 
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It is possible, however, that some of the reinforcing effect of 
“sensor)- feed-back” is unconditioned, A baby appears to be reinforced 
bv stimulation from the environment which has not been followed 
bv primary reinforcement. The baby’s rattle is an example. The 
capacity to be reinforced in this way could have arisen in the evolu- 
tionaiy- process, and it may have a parallel in the reinforcement we 
receive from simply “making the world behave.” Any organism 
which is reinforced by its success in manipulating nature, regardless 
of the momcntaiy' consequences, will be in a favored position when 
important consequences follow. 

Several important generalized reinforcers arise when behavior is 
reinforced by other people. A simple case is attention. The child who 
misbehaves “just to get attention” is familiar. The attention of 
people is reinforcing because it is a necessary condition for other 
reinforcements from them. In general, only people who are attend¬ 
ing to us reinforce our behavior. Tlie attention of someone who is 
particularly likely to supply reinforcement—a parent, a teacher, or 
a loved one—is an especially good generalized reinforcer and sets up 
especially strong attention-getting behavior. Many verbal responses 
specifically demand attention—for example, “Look,” “See,” or the 
vocative use of a name. Other characteristic forms of behavior which 
are commonly strong because they receive attention are feigning 
illness, being annoying, and being conspicuous (exhibitionism). 

Attention is often not enough. Another person is likely to reinforce 
only that part of one’s behavior of which he approves, and any sign 
of his approval therefore becomes reinforcing in its own right. Be¬ 
havior which evokes a smile or the verbal response “That’s right” or 
“Good” or any other commendation is strengthened. We use this 
generalized reinforcer to establish and shape the behavior of others, 
particularly in education. For example, we teach both children and 
adults to speak correctly by saying “That’s right” when appropriate 
behavior is emitted. 

A still stronger generalized reinforcer is affection. It may be espe¬ 
cially connected with sexual contact as a primary reinforcer but 
when anyone who shows affection supplies other kinds of reinforce¬ 
ment as well, the effect is generalized. 
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It is diflScult to define, obsen-e, and measure attention, approval, 
and affection. They are not things but aspects of the behavior of 
others. Their subtle physical dimensions present difficulties not only 
for the scientist who must studv them but also for the individual who 
is reinforced by them. If we do not easily see that someone is paying 
attention or that he approves or is affectionate, our behavior will 
not be consistently reinforced. It may therefore be weak, may tend to 
occur at the wrong time, and so on. Wc do not “know what to do to 
get attention or affection or when to do it.” The child struggling for 
attention, the lover for a sign of affection, and the artist for profes¬ 
sional approval show the persevering behavior which, as we shall 
see in Chapter \'], results from only intermittent reinforcement. 

Anotlier generalized reinforccr is the subrnissiveness of others. 
When someone has been coerced into supplying various reinforce¬ 
ments, any indication of his acquiescence becomes a generalized rein¬ 
forcer. The bully is reinforced by signs of cowardice, and members of 
the ruling class by signs of deference. Prestige and esteem arc general¬ 
ized reinforcers only insofar as they guarantee that other people will 
act in certain ways. That "having one’s own way" is reinforcing is 
shown by the behavior of those who control for the sake of control. 
The physical dimensions of subrnissiveness arc usually not so subtle 
as those of attention, approval, or affection. The bully may insist 
upon a clear-cut sign of his dominance, and ritualistic practices 

emphasize deference and respect. 

A generalized reinforcer distinguished by its physical specifications 
is the token. Tlie commonest example is money. It is the generalized 
reinforcer par excellence because, although "money won’t buy every¬ 
thing,” it can be exchanged for primar)' reinforcers of great variety. 
Behavior reinforced with money is relatively independent of the 
momentary deprivation of the organism, and the general usefulness 
of money as a reinforcer depends in part upon this fact. Its effective¬ 
ness is also due to its physical dimensions. These permit a sharper 
contingency between behavior and consequence: when we are paid 
in money, we know what our behavior has accomplished and what 
behavior has accomplished it. The reinforcing effect can also be more 
successfully conditioned: the exchange value of money is more 
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obx ious than that of attention, approval, affection, or even submis- 
sivencss. 

^^oney is not the only token. In education, for example, the indi¬ 
vidual behaves in part because of the marks, grades, and diplomas 
which he has received. These are not so readily exchanged for pri¬ 
mary reinforcement as money, but the possibility of exchange is there. 
Educational tokens form a series in which one may be exchanged 
for the next, and the commercial or prestige value of the final token, 
the diploma, is usually clear. As a rule, prizes, medals, and scholar¬ 
ships for high marks or specialized skills or achievements are not 
explicitly paired with primary reinforcers, but the clear-cut physical 
dimensions of such awards are an advantage in arranging contingen¬ 
cies. Usually the ultimate reinforcement is similar to that of prestige 
or esteem. 

It is easy to forget the origins of the generalized reinforcers and 
to regard them as reinforcing in their own right. We speak of the 
“need for attention, approval, or affection,” “the need to dominate,” 
and “the love of money” as if they were primary conditions of depri¬ 
vation. But a capacity to be reinforced in this way could scarcely 
have evolved in the short time during which the required conditions 
have prevailed. Attention, affection, approval, and submission have 
presumably existed in human society for only a very brief period, as 
the process of evolution goes. Moreover, they do not represent fixed 
forms of stimulation, since they depend upon the idiosyncrasies of 
particular groups. Insofar as affection is mainly sexual, it may be 
related to a condition of primary deprivation which is to some extent 
independent of the personal history of the individual, but the “signs 
of affection” which become reinforcing because of their association 
with sexual contact or with other reinforcers can scarcely be rein¬ 
forcing for genetic reasons. Tokens are of even more recent advent, 
and it is not often seriously suggested that the need for them is 
inherited. We can usually watch the process through which a child 
comes to be reinforced by money. Yet the “love of money” often 
seems to be autonomous as the “need for approval,” and if we con¬ 
fined ourselves to the observed effectiveness of these generalized 
reinforcers, we should have as much reason for assuming an inherited 
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need for money as for attention, approval, affection, or domination. 

Eventually generalized reinforcers are effective even though the 
primaiA’ reinforcers upon which they are based no longer accompany 
them. We plav games of skill for their own sake. We get attention 
or approval for its own sake. Affection is not always followed by a 
more explicit sexual reinforcement. The submissiveness of others is 
reinforcing even though we make no use of it. A miser may be so 
reinforced by money that he will starve rather than give it up. These 
obser\'able facts must have their place in any theoretical or practical 
consideration. They do not mean that generalized reinforcers are 
anything more than the physical properties of the stimuli observed 
in each case or that there are any nonphysical entities which must 
be taken into aceount. 

WHY IS A REINFORCER REINFORCING? 

Tlie Law of Effect is not a theor\'. It is simply a rule for strength¬ 
ening behavior. When we reinforce a response and obser\c a change 
in its frequency, we can easily report what has happened in objective 
terms. But in explaining why it has happened we are likely to resort 
to theor)\ Why does reinforcement reinforce? One thcor)' is that an 
organism repeats a response because it finds the consequences pleas¬ 
ant" or "satisfying." But in what sense is this an explanation within 
the framework of a natural science? “Pleasant or satisfying ap¬ 
parently do not refer to physical properties of reinforcing events, 
since the physical sciences use neither these terms nor any equivalents. 
The terms must refer to some effect upon the organism, but can we 
define this in such a way that it will be useful in accounting for 
reinforcement? 

It is sometimes argued that a thing is pleasant if an organism 
approaches or maintains contact with it and unpleasant if the organ¬ 
ism avoids it or cuts it short. There are many variations on this 
attempt to find an objective definition, but they are all subject to 
the same criticism: the behavior specified may be merely another 
product of the reinforcing effect. To say that a stimulus is pleasant 
in the sense that an organism tends to approach or prolong it may be 
only another way of saying that the stimulus has reinforced the 
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behavior of approaching or prolonging. Instead of defining a reinforc¬ 
ing effect in terms of its effect upon behavior in general, we have 
simply specified familiar behavior which is almost inevitably rein¬ 
forced and hence generally available as an indicator of reinforcing 
power. It we then go on to say that a stimulus is reinforcing because 
it is pleasant, what purports to be an explanation in terms of two 
effects is in reality a redundant description of one. 

An alternative approach is to define “pleasant” and “unpleasant” 
(or “satisfying” and “annoying”) by asking the subject how he “feels” 
about certain events. This assumes that reinforcement has two effects 
—it strengthens behavior and generates “feelings”—and that one is a 
function of the other. But the functional relation may be in the other 
direction. When a man reports that an event is pleasant, he may 
be merely reporting that it is the sort of event which reinforces him 
or toward which he finds himself tending to move because it has 
reinforced such movement. We shall see in Chapter XVII that one 
could probably not acquire verbal responses with respect to pleasant¬ 
ness as a purely private fact unless something like this were so. In any 
case, the subject himself is not at an especially good point of vantage 
for making such observations. “Subjective judgments” of the pleasant¬ 
ness or satisfaction provided by stimuli are usually unreliable and 
inconsistent. As the doctrine of the unconscious has emphasized, we 
may not be able to report at all upon events which can be shown to 
be reinforcing to us or we may make a report which is in direct con¬ 
flict with objective obsenations; we may report as unpleasant a type 
of event which can be shown to be reinforcing. Examples of this 
anomaly range from masochism to martyrdom. 

It is sometimes argued that reinforcement is effective because it 
reduces a state of deprivation. Here at least is a collateral effect which 
need not be confused with reinforcement itself. It is obvious that 
deprivation is important in operant conditioning. We used a hungry 
pigeon in our experiment, and we could not have demonstrated oper¬ 
ant conditioning otherwise. The hungrier the bird, the oftener it 
responds as the result of reinforcement. But in spite of this connec¬ 
tion it is not true that reinforcement always reduces deprivation. 
Conditioning'may occur before any substantial change can take place 
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in the deprivation measured in other ways. All we can say is that the 
type of event which reduces deprivation is also reinforcing. 

The connection between reinforcement and satiation must be 
sought in the process of evolution. We can scarcely overlook the 
great biological significance of the primarv' reinforcers. Food, water, 
and sexual contact, as well as escape from injurious conditions 
(Chapter XI), arc obviously connected with the well-being of the 
organism. An individual who is readily reinforced by such events 
will acquire highly efficient behavior. It is also biologically advan¬ 
tageous if the behavior due to a given reinforcement is especially 
likely to occur in an appropriate state of deprivation. Thus it is im¬ 
portant, not only that any behavior which leads to the receipt of 
food should become an important part of a repertoire, but that this 
behavior should be particularly strong when the organism is hungry^. 
These two advantages are presumably responsible for the fact that 
an organism can be reinforced in specific ways and that the result 
will be observed in relevant conditions of deprivation. 

Some forms of stimulation are positively reinforcing although 
they do not appear to elicit behavior having biological significance. 
A baby is reinforced, not only by food, but by the tinkle of a bell 
or the sparkle of a bright object. Behavior which is consistently fol¬ 
lowed by such stimuli shows an increased probability. It is difficult, 
if not impossible, to trace these reinforcing effects to a history of 
conditioning. Later we may find the same individual being reinforced 
by an orchestra or a colorful spectacle. Here it is more difficult to 
make sure that the reinforcing effect is not conditioned. However, 
we may plausibly argue that a capacity to be reinforced by any feed¬ 
back from the environment would be biologically advantageous, since 
it would prepare the organism to manipulate the environment suc¬ 
cessfully before a given state of deprivation developed. When the 
organism generates a tactual feed-back, as in feeling the texture of a 
piece of cloth or the surface of a piece of sculpture, the conditioning 
is commonly regarded as resulting from sexual reinforcement, even 
when the area stimulated is not primarily sexual in function. It is 
tempting to suppose that other forms of stimulation produced by 
behavior are similarly related to biologically important events. 
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When the environment changes, a capacity to be reinforced by a 
given event may have a biological disadvantage. Sugar is highly rein¬ 
forcing to most members of the human species, as the ubiquitous 
candy counter shows. Its effect in this respect far exceeds current 
biological requirements. This was not true before sugar had been 
grown and refined on an extensive scale. Until a few hundred years 
ago, the strong reinforcing effect of sugar must have been a biological 
advantage. The environment has changed, but the genetic endow¬ 
ment of the organism has not followed suit. Sex provides another 
example. There is no longer a biological advantage in the great 
reinforcing effect of sexual contact, but we need not go back many 
hundreds of years to find conditions of famine and pestilence under 
which the power of sexual reinforcement offered a decisive advantage. 

A biological explanation of reinforcing power is perhaps as far as we 
can go in saying why an event is reinforcing. Such an explanation is 
probably of little help in a functional analysis, for it does not provide 
us with any way of identifying a reinforcing stimulus as such before 
we have tested its reinforcing power upon a given organism. We must 
therefore be content with a sun'ey in terms of the effects of stimuli 
upon behavior. 

ACCIDENTAL CONTINGENCIES AND 
•‘SUPERSTITIOUS” BEHAVIOR 

It has been argued that Thorndike’s experiment is not typical of 
the learning process because the cat cannot “see the connection” be¬ 
tween moving a latch and escaping from a box. But seeing a connec¬ 
tion is not essential in operant conditioning. Both during and after 
the process of conditioning, the human subject often talks about his 
behavior in relation to his environment (Chapter XVII). His reports 
may be useful in a scientific account, and his reaction to his own 
behavior may even be an important link in certain complex processes. 
But such reports or reactions are not required in the simple process 
of operant conditioning. This is evident in the fact that one may not 
be able to describe a contingency which has clearly had an effect. 

Nor need there be any permanent connection between a response 
and its reinforcement. We made the receipt of food contingent upon 
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the response of our pigeon by arranging a mechanical and electrical 
connection. Outside the laboratoiA’ various physical systems are re¬ 
sponsible for contingencies between behavior and its consequences. 
But these need not. and usually do not. affect the organism in any 
other way. So far as the organism is concerned, the only important 
property of the contingency is temporal. I'he reinforcer simply 
follows the response. How this is brought about does not matter. 

We must assume that the presentation of a reinforccr always re¬ 
inforces something, since it necessarily coincides with some behavior. 
We have also seen that a single reinforcement may have a substantial 
effect. If there is only an accidental connection between the response 
and the appearance of a reinforcer, the behavior is called “super¬ 
stitious.'’ We may demonstrate this in the pigeon by accumulating 
the effect of several accidental contingencies. Suppose we give a pigeon 
a small amount of food ever^’ fifteen seconds regardless of what it is 
doing. When food is first given, the pigeon will be behaving in some 
way—if only standing still—and conditioning will take place. It is 
then more probable that the same behavior will be in progress when 
food is given again. If this proves to be the case, the “operant” will 
be further strengthened. If not, some other behavior will be strength¬ 
ened. Eventually a given bit of behavior reaches a frequency at which 
it is often reinforced. It then becomes a permanent part of the reper¬ 
toire of the bird, even though the food has been given by a clock 
which is unrelated to the bird’s behavior. Conspicuous responses 
which have been established in this way include turning sharply to 
one side, hopping from one foot to the other and back, bowing and 
scraping, turning around, strutting, and raising the head. The topog¬ 
raphy of the behavior may continue to drift with further reinforce¬ 
ments, since slight modifications in the form of response may coin¬ 
cide with the receipt of food. 

In producing superstitious behavior, the interv'als at which food 
is given are important. At sixty seconds the effect of one reinforce¬ 
ment is largely lost before another can occur, and other behavior is 
more likely to appear. Superstitious behavior is therefore less likely 
to emerge, though it may do so if the experiment is carried on for a 
long time. At fifteen seconds the effect is usually almost immediate. 
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When a superstitious response has once been established, it will 
sim ive even when reinforced only infrequently. 

I'he pigeon is not exceptionally gullible. Human behavior is also 
heavily superstitious. Only a small part of the behavior strengthened 
by accidental contingencies develops into the ritualistic practices 
which wc call “superstitions,” but the same principle is at work. 
Suppose we find a ten-dollar bill while walking through the park (and 
suppose this is an event which has a considerable reinforcing effect). 
Whatever wc were doing, or had just been doing, at the moment we 
found the bill must be assumed to be reinforced. It would be difficult 
to ]5ro\c this in a rigorous way, of course, but it is probable that we 
shall be more likely to go walking again, particularly in the same or a 
similar park, that we shall be slightly more likely to keep our eyes 
cast down\\’ard precisely as we did when we saw the money, and so 
on. Ibis behavior will vary with any state of deprivation to which 
money is relevant. We should not call it superstitious, but it is gen¬ 
erated by a contingency which is only rarely “functional.” 

Some contingencies which produce superstitious behavior are not 
entirely accidental. A response is sometimes likely to be followed by 
a consequence which it nevertheless does not “produce.” The best 
examples involve a type of stimulus which is reinforcing when re¬ 
moved (Chapter XI). The termination of a brief stimulus of this sort 
may occur at just the righc time to reinforce the behavior generated 
by its onset. Tbe aversive stimulus appears and the organism becomes 
active; the stimulus terminates, and this reinforces some part of the 
behavior. Certain illnesses, lamenesses, and allergic reactions are of 
such duration that any measure taken to “cure” them is likely to be 
reinforced when the condition clears up. The measure need not actu¬ 
ally be responsible for the cure. The elaborate rituals of nonscien- 
tific medicine appear to be explained by this characteristic of many 
forms of illness. 

In superstitious operant behavior, as in the superstitious condi¬ 
tioned reflexes discussed in Chapter IV, the process of conditioning 
has miscarried. Conditioning offers tremendous advantages in equip¬ 
ping the organism with behavior which is effective in a novel environ¬ 
ment, but there appears to be no way of preventing the acquisition of 
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non-advaiitagcous behavior tliroiigh accident. Ciiriouslv, this diffi- 
ciiltv must have increased as the process of conditioning was acceler¬ 
ated in the course of evolution. If, for example, three reinforcements 
were a]wa\s required in order to change the probability of a response, 
superstitious beha\ ior would be unlikely. It is only because organisms 
have reached the point at which a single contingency makes a sub¬ 
stantial change that the)- arc vulnerable to coincidences. 

Superstitious rituals in human society usually invohe verbal for¬ 
mulae and are transmitted as part of the culture. To this extent they 
differ from the simple effect of accidental operant reinforcement. 
But thev must have had their origin in the same process, and they arc 
probably sustained by occasional contingencies which follow the 
same pattern. 

COALS. PURPOSFS, .\NO OPHEIl FINAL CAUSES 

It is not correct to sav that operant reinforcement “strengthens the 
response which precedes it.” The response has already occurred and 
cannot be changed. What is changed is the future probability of re¬ 
sponses in the same class. It is the operant as a class of behavior, 
rather than the response as a particular instance, which is condi¬ 
tioned. 7 hcrc is, therefore, no violation of the fundamental principle 
of science which rules out “final causes.” But this principle is violated 
when it is asserted that behavior is under the control of an “incen¬ 
tive” or “goal” which the organism has not yet achieved or a “pur¬ 
pose" which it has not yet fulfilled. Statements which use such words 
as “incentive” or “purpose” arc usually reducible to statements about 
operant conditioning, and only a slight change is required to bring 
them within the framework of a natural science. Instead of saying 
that a man behaves because of the consequences which are to follow 
his behavior, we simply say that he bcha\’es because of the conse¬ 
quences which have followed similar behavior in the past. This is, 
of course, the Law of Effect or operant conditioning. 

It is sometimes argued that a response is not fully described until 
its purpose is referred to as a current property. But what is meant by 
“describe”? If we obseiA-e someone walking down the street, we ma\' 
report this event in the language of physical science. If wc then add 
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that “his purpose is to mail a letter/' have we said anything which 

was not included in our first report? Evidently so, since a man may 

walk down the street “for many purposes” and in the same physical 

wav in each case. But the distinction which needs to be made is not 
¥ 

between instances of behavior; it is between the variables of which 
behavior is a function. Purpose is not a property of the behavior itself; 
it is a way of referring to controlling variables. If we make our report 
after we have seen our subject mail his letter and turn back, we 
attribute “purpose” to him from the event which brought the be¬ 
havior of walking down the street to an end. This event “gives mean¬ 
ing” to his performance, not by amplifying a description of the 
behavior as such, but by indicating an independent variable of which 
it may have been a function. We cannot see his “purpose” before see¬ 
ing that he mails a letter, unless we have observed similar behavior 
and similar consequences before. Where we have done this, we use 
the term simply to predict that he will mail a letter upon this 
occasion. 

Nor can our subject see his own purpose without reference to 
similar events. If we ask him why he is going down the street or what 
his purpose is and he says, “I am going to mail a letter,” we have not 
learned anything new about his behavior but only about some of its 
possible causes. The subject himself, of course, may be in an advan¬ 
tageous position in describing these variables because he has had an 
extended contact with his own behavior for many years. But his state¬ 
ment is not therefore in a different class from similar statements 
made by others who have observed his behavior upon fewer occasions. 
As we shall see in Chapter XVII, he is simply making a plausible pre¬ 
diction in terms of his experiences with himself. Moreover, he may 
be wrong. He may report that he is “going to mail a letter,” and he 
may indeed carry an unmailed letter in his hand and may mail it at 
the end of the street, but we may still be able to show that his be¬ 
havior is primarily determined by the fact that upon past occasions 
he has encountered someone who is important to him upon just such 
a walk. He may not be “aware of this purpose” in the sense of being 
able to say that his behavior is strong for this reason. 

The fact that operant behavior seems to be “directed toward the 
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future” is misleading. Consider, for example, the case of “looking for 
something.” In what sense is the ““something” which has not yet 
been found relevant to the behavior? Suppose we condition a pigeon 
to peck a spot on the wall of a box and then, when the operant is 
well established, remove the spot. The bird now goes to the usual 
place along the wall. It raises its head, cocks its eye in the usual direc¬ 
tion. and may even emit a weak peck in the usual place. Before ex¬ 
tinction is ver\' far advanced, it returns to the same place again and 
again in similar behavior. Must we say that the pigeon is ‘ looking for 
the spot”? Must we take the “looked for” spot into account in ex¬ 
plaining the behavior? 

It is not difficult to interpret this example in terms of operant 
reinforcement. Since visual stimulation from the spot has usually 
preceded the receipt of food, the spot has become a conditioned re¬ 
inforcer. It strengthens the behavior of looking in given directions 
from different positions. Although we have undertaken to condition 
only the pecking response, we have in fact strengthened many dif¬ 
ferent kinds of precurrent behavior which bring the bird into positions 
from which it sees the spot and pecks it. These responses continue to 
appear, even though we have removed the spot, until extinction 
occurs. The spot that is “being looked for” is the spot which has 
occurred in the past as the immediate reinforcement of the behavior 
of looking. In general, looking for something consists of emitting re¬ 
sponses which in the past have produced “something” as a conse¬ 
quence. 

The same interpretation applies to human behavior. When we see 
a man moving about a room opening drawers, looking under maga¬ 
zines, and so on, we may describe his behavior in fully objective 
terms: “Now he is in a certain part of the room; he has grasped a 
book between the thumb and forefinger of his right hand; he is lift¬ 
ing the book and bending his head so that any object under the book 
can be seen.” We may also “interpret” his behavior or “read a mean¬ 
ing into it” by saying that “he is looking for something” or, more 
specifically, that “he is looking for his glasses.” What we have added 
is not a further description of his behavior but an inference about 
some of the variables responsible for it. There is no current goal, in- 
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centive> purpose, or meaning to be taken into account. This is so 
even if we ask him what he is doing and he says, “I am looking for 
my glasses.” This is not a further description of his behavior but of 
the variables of which his behavior is a function; it is equivalent to “I 
have lost my glasses,” “I shall stop what I am doing when I find my 
glasses,” or “When I have done this in the past, I have found my 
glasses.” These translations may seem unnecessarily roundabout, but 
only because expressions involving goals and purposes are abbrevi¬ 
ations. 

Very often we attribute purpose to behavior as another way of 
describing its biological adaptability. This issue has already been dis¬ 
cussed, but one point may be added. In both operant conditioning 
and the evolutionary selection of behavioral characteristics, conse¬ 
quences alter future probability. Reflexes and other innate patterns 
of behavior evolve because they increase the chances of survival of 
the species. Operants grow strong because they are followed by impor¬ 
tant consequences in the life of the individual. Both processes raise 
the question of purpose for the same reason, and in both the appeal 
to a final cause may be rejected in the same way. A spider does not 
possess the elaborate behavioral repertoire with which it constructs a 
web because that web will enable it to capture the food it needs to 
survive. It possesses this behavior because similar behavior on the 
part of spiders in the past has enabled them to capture the food they 
needed to survive. A series of events have been relevant to the be¬ 
havior of web-making in its earlier evolutionary history. We are wrong 
in saying that we observe the "purpose” of the web when we observe 
similar events in the life of the individual. 
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THE CONTINUITY OF BEHAVIOR 

Operant conditioning shapes behavior as a sculptor shapes a 
lump of clay. Although at some point the sculptor seems to have pro¬ 
duced an entirely novel object, we can always follow the process back 
to the original undifferentiated lump, and we can make the successive 
stages by which we return to this condition as small as we wish. At 
no point does anything emerge which is ver^’ different from what pre¬ 
ceded it. The final product seems to have a special unity or integrity 
of design, but we cannot find a point at which this suddenly appears. 
In the same sense, an operant is-not something which appears full 
grown in the behavior of the organism. It is the result of a continuous 
shaping process. 

The pigeon experiment demonstrates this clearly. “Raising the 
head” is not a discrete unit of behavior. It does not come, so to 
speak, in a separate package. We reinforce only slightly exceptional 
values of the behavior obser\'ed while the pigeon is standing or mov¬ 
ing about. We succeed in shifting the whole range of heights at which 
the head is held, but there is nothing which can be accurately de- 
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scribed as a new “response.” A response such as turning the latch in 
a problem box appears to be a more discrete unit, but only because 
the continuity with other behavior is more difficult to observe. In the 
pigeon, the response of pecking at a spot on the wall of the experi¬ 
mental box seems to differ from stretching the neck because no other 
behavior of the pigeon resembles it. If in reinforcing such a response 
we simply wait for it to occur—and we may have to wait many hours 
or days or weeks—the whole unit appears to emerge in its final form 
and to be strengthened as such. There may be no appreciable be¬ 
havior which we could describe as “almost pecking the spot.” 

The continuous connection between such an operant and the gen¬ 
eral behavior of the bird can nevertheless easily be demonstrated. It 
is the basis of a practical procedure for setting up a complex response. 
To get the pigeon to peck the spot as quickly as possible we proceed 
as follows: We first give the bird food when it turns slightly in the 
direction of the spot from any part of the cage. This increases the 
frequency of such behavior. We then withhold reinforcement until a 
slight movement is made toward the spot. This again alters the gen¬ 
eral distribution of behavior without producing a new unit. We con¬ 
tinue by reinforcing positions successively closer to the spot, then by 
reinforcing only when the head is moved slightly forward, and finally 
only when the beak actually makes contact with the spot. We may 
reach this final response in a remarkably short time. A hungry bird, 
well adapted to the situation and to the food tray, can usually be 
brought to respond in this way in two or three minutes. 

The original probability of the response in its final form is very 
low; in some cases it may even be zero. In this way we can build com¬ 
plicated operants which would never appear in the repertoire of the 
organism otherwise. By reinforcing a series of successive approxima¬ 
tions, we bring a rare response to a very high probability in a short 
time. This is an effective procedure because it recognizes and utilizes 
the continuous nature of a complex act. The total act of turning 
toward the spot from any point the box, walking toward it, raising 
the head, and striking the spot may seem to be a functionally coherent 
unit of behavior; but it is constructed by a continual process of differ¬ 
ential reinforcement from undifferentiated behavior, just as the 
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sculptor shapes liis figure from a lump of clay. When we wait for a 
single complete instance, we reinforce a similar sequence but far less 
effectively because the earlier steps are not optimally strengthened. 

This account is inaccurate in one respect. We may detect a discon¬ 
tinuity between bringing the head close to the spot and pecking. The 
pecking movement usually emerges as an obviouslv preformed unit. 
There are two possible explanations. A mature pigeon will already 
have developed a well-defined pecking response which may emerge 
upon the present occasion. The history of this response might show 
a similar continuity if we could follow it. It is possible, however, that 
there is a genetic discontinuity, and that in a bird such as the pigeon 
the pecking response has a special strength and a special coherence as 
a form of species behavior. Vomiting and sneezing are human re¬ 
sponses which probably have a similar genetic unity. Continuit}' with 
other behavior must be sought in the cvolutionar)’ process. But these 
genetic units are rare, at least in the vertebrates. The behavior with 
which we are usually concerned, from either a theoretical or practical 
point of view, is continuously modified from a basic material which 
is largely undifferentiated. 

Through the reinforcement of slightly exceptional instances of his 
behavior, a child learns to raise himself, to stand, to walk, to grasp 
objects, and to move them about. Later on, through the same process, 
he learns to talk, to sing, to dance, to play games—in short, to exhibit 
the enormous repertoire characteristic of the normal adult. When we 
suiA’ey behavior in these later stages, we find it convenient to distin¬ 
guish between various operants which differ from each other in topog¬ 
raphy and produce different consequences. In this way behavior is 
broken into parts to facilitate analysis. These parts are the units 
which we count and whose frequencies play an important role in 
arriving at laws of behavior. They are the “acts’’ into which, in the 
vocabulary of the layman, behavior is divided. But if we are to ac¬ 
count for many of its quantitative properties, the ultimately continu¬ 
ous nature of behavior must not be forgotten. 

Neglect of this characteristic has been responsible for several diffi¬ 
cult problems in behavior theory. An example is the effect sometimes 
spoken of as “response generalization,” “transfer,” or “response in- 
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diiction.” In reinforcing one operant we often produce a noticeable 
increase in the strength of another. Training in one area of skilled 
behavior may improve performance in another. Success in one field 
of activity may increase the tendency to be active in other fields. By 
arranging optimal reinforcing contingencies in the clinic or institu¬ 
tion. the psychotherapist strengthens behavior in the world at large. 
But how is this possible? What is the “transfer” which appears to 
strengthen bcliavior without reinforcing it directly? This is a good 
example of a pseudo problem. We divide behavior into hard and 
fast units and are then surprised to find that the organism disregards 
the boundaries we have set. It is difficult to conceive of two responses 
which do not have something in common. Sometimes the same mus¬ 
cular system is used. The effect of a reinforcement may reflect this 
fact rather than our arbitrary' practice of calling the responses separate 
units. Again, when we reinforce the final response in a sequence con¬ 
taining many precurrent members, we may strengthen all units which 
contain the same precurrent members. Our skill in manipulating tools 
and instruments transfers from one field of reinforcement to another. 

The traditional explanation of transfer asserts that the second re¬ 
sponse is strengthened only insofar as the responses “possess identical 
elements.” This is an effort to maintain the notion of a unit of re¬ 
sponse. A more useful way of putting it is to say that the elements 
are strengtliened wherever they occur. This leads us to identify the 
element rather than the response as the unit of behavior. It is a sort 
of behavioral atom, which may never appear by itself upon any single 
occasion but is the essential ingredient or component of all observed 
instances. The reinforcement of a response increases the probability 
of all responses containing the same elements. Verbal behavior 
supplies especially good examples of the need to consider these atoms. 
An enormous number of verbal responses are executed by the same 
musculature. They are responses, therefore, which are presumably 
composed of a fairly small number of identical elements. This is not 
usually recognized in the customary practice of regarding verbal be¬ 
havior as composed of separate units—for example, the “words” of 
the grammarian. A rigorous analysis shows that the word is by no 
means the functional unit. Larger complexes of words—idioms. 
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phrases, or memorized passages—may var\- together under the control 
of a single variable. On the other hand, we may observe the separate 
functional control of “atoms” at least as small as the separate speech 
sounds. We have to recognize these small units in order to account 
for such distorted verbal responses as spoonerisms and certain verbal 
slips, as well as the stylistic devices of alliteration, assonance. rh\ nie, 
and rhvthni. 

We lack adequate tools to deal with the continuity of behavior or 
with the interaction among operants attributable to common atomic 
units. 'The operant represents a valid level of analvsis, however, be¬ 
cause the properties which define a response are observable data. A 
given set of properties may be given a functional unity. Although 
methods must eventually be developed which will not emphasize 
units at this level, they are not neccssar)' to our understanding of the 
principal dynamic properties of behavior. 

DIFFLREN'riAL REINFORCEMENF 

Although operant reinforcement is always a matter of selecting cer¬ 
tain magnitudes of response as against others, we may distinguish 
between producing a relatively complete new unit and making slight 
changes in the direction of greater effectiveness in an existing unit. 
In the first case, we are interested in how behavior is acquired; in 
the second, in how it is refined. It is the difference between “knowing 
how to do something” and “doing it well.” The latter is the field of 
skill. 

The contingency which improves skill is the differential reinforce¬ 
ment of responses possessing special properties. It may be supplied 
automatically by the mechanical exigencies of the environment. In 
learning to throw a ball well, for example, certain responses must re¬ 
lease the ball from the fingers at the moment of its greatest forward 
speed. 7'hese responses are differentially reinforced by the fact that, 
when so released, the ball covers a considerable distance. Other in¬ 
stances in which the release comes before or after the proper moment 
are not so reinforced. We are likely to forget how complex an act 
this is and how much differential reinforcement is required in the 
young child to produce a properly timed sequence. In games, crafts. 
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and certain artistic performances extremely fine differences in the ex¬ 
ecution of behavior make important differences in the consequences. 
(The consequences at issue are generally the conditioned reinforcers 
summarized in Chapter V. Primary reinforcers are seldom involved. 
The negative reinforcers to be considered in Chapter XI also are im¬ 
portant. For example, the consequences which are effective in condi¬ 
tioning postural responses in locomotion or the maintenance of an 
upright position are largely the avoidance of falls, bumps, and awk¬ 
ward or painful postures.) 

The reinforcement which develops skill must be immediate. Other¬ 
wise, the precision of the differential effect is lost. In many practical 
areas skilled behavior is encouraged by arranging a quick report of 
accomplishment. In rifle practice, for example, extremely small-scale 
properties of response are differentially reinforced by a hit or a miss. 
Properties of this magnitude can be selected only if the differential 
reinforcement is immediate. But even when a hit can be seen by the 
rifleman, the report is delayed by the time which the bullet takes to 
reach the target. Possibly this gap is bridged by conditioned reinforce¬ 
ment from the “feel” of the shot. The rifleman eventually “knows” 
before the target is hit whether the shot was good or bad. His own 
behavior generates a stimulating feed-back, certain forms of which 
are followed by hits, others by misses. The more immediate problem 
is to shoot in such a way as to generate the “feel” followed by a hit. 
In more vigorous enterprises the feed-back is clearer. Good form in 
bowling, for example, is reinforced by feed-back from the bowler’s 
body. This does not mean that the rifleman will continue to shoot 
well, or the bowler to bowl well, even though he receives no report 
of the effect upon the target or pins. The report is needed to main¬ 
tain the conditioned reinforcing power of the feed-back. 

If the differential contingencies change, the topography of behavior 
changes with them. Even the very common responses which enable 
us to walk upright continue to be modified by the environment. 
When we walk on the deck of a ship at sea, a special set of contin¬ 
gencies prevails in maintaining our orientation in the gravitational 
field. The new differential reinforcement sets up “sea legs.” At the 
end of the voyage the old contingencies work a reverse change. Con- 
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tingencies of reinforcement which are arranged by society arc espe¬ 
cially likely to shift. Verbal behavior supplies many good examples. 
In the niirser), crude vocal responses are successful; the indulgent 
parent may even reinforce “baby talk” into adolescent or adult years. 
But eventuallv, verbal behavior is successful onlv when it generates 
suitable behavior in the average listener; therefore, the form of the 
behavior comes to correspond more and more closely to the standards 
of a given community. When we move from one community to an¬ 
other. the topography of our behavior may change. 

Some differential reinforcements make a response more or less 
intense or forceful without appreciably altering its topography. Cer¬ 
tain natural contingencies in the environment lead us to push or lift 
harder to move objects, to pull harder to break objects apart, to jump 
harder to reach a given height, and so on. In calling to someone at a 
distance or in talking to a deaf person, our verbal behavior is rein¬ 
forced only when it reaches a certain level of loudness. I’csts of 
strength and other competitive games supply examples of these differ¬ 
ential contingencies. When a heavy ball is thrown beyond a certain 
mark, when a horizontal bar is cleared in vaulting or in jumping, 
when a ball is batted over the fence (and when, as a result, a record 
is broken or a match or game won), differential reinforcement is at 
work. It may to some extent change the topography of the behavior 
and produce “good form,” but it has an important effect upon the 
mere force with which the behavior is executed. 

We use differential reinforcement to shape and intensify the be¬ 
havior of others in what may be spoken of, as we shall see in Chap¬ 
ter XX, as deliberate control. The effect may also be wholly uninten¬ 
tional. The mother who complains that her three-year-old child 
whines and cries for attention in an annoying way may not realize 
that her own reinforcing practices are responsible. If she is busy with 
other matters, she is likely not to respond to a call or request made in 
a quiet tone of voice. When the child raises his voice, she replies. 
Tliis is differential reinforcement. The average intensity of the child's 
vocal behavior rises. When the mother has adapted to the new level, 
again only the louder instances are reinforced. Further differentiation 
in the direction of loud responses follows. The child's voice may also 
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var}' in intonation. What we call "whining” may be thought of as 
speaking with a small admixture of crying. Such speech is more likely 
to secure an effect and is therefore differentially strengthened. In fact, 
what we call annoying behavior in general is just that behavior which 
is especially effective in arousing another person to action. Differential 
reinforcement supplied by a preoccupied or negligent parent is very 
close to the procedure we should adopt if we were given the task of 
conditioning a child to be annoying. 

THE MAINTENANCE OF BEHAVIOR 

One reason the term “learning” is not equivalent to "operant con¬ 
ditioning” is that traditionally it has been confined to the process of 
learning how to do something. In trial-and-error learning, for example, 
the organism learns how to get out of a box or how to find its way 
through a maze. It is easy to see why the acquisition of behavior 
should be emphasized. Early devices for the study of learning did not 
reveal the basic process directly. Tlie effect of operant reinforcement 
is most conspicuous when there is a gross change in behavior. Such 
a chance occurs when an organism learns how to make a response 
which it did not or could not make before. A more sensitive measure, 
however, enables us to deal with cases in which the acquisition of 
behavior is of minor importance. 

Operant conditioning continues to be effective even when there is 
no further change which can be spoken of as acquisition or even as 
improvement in skill. Behavior eontinues to have consequences and 
these continue to be important. If consequences are not forthcoming, 
extinction occurs. When we come to consider the behavior of the 
organism in all the complexity of its everyday life, we need to be con¬ 
stantly alert to the prevailing reinforcements which maintain its be¬ 
havior. We may, indeed, have little interest in how that behavior was 
first acquired. Our concern is only with its present probability of 
occurrence, which can be understood only through an examination of 
current contingencies of reinforcement. This is an aspect of reinforce¬ 
ment which is scarcely ever dealt with in classical treatments of 
learning. 
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INTERMITTENT REINFORCEMENT 

In general, behavior which acts upon the immediate physical en¬ 
vironment is consistently reinforced. We orient ourselves toward 
objects and approach, reach for, and seize them with a stable reper¬ 
toire of responses which have uniform consequences arising from the 
optical and mechanical properties of nature. It is possible, of course, 
to disturb the uniformitv. In a “house of mirrors” in an amusement 
park, or in a room designed to supply misleading cues to the vertical, 
well-established responses may fail to have their usual effects. But the 
fact that such conditions are so unusual as to have commercial value 
testifies to the stability of the everyday world. 

A large part of behavior, however, is reinforced only intermittently. 
A given consequence may depend upon a series of events which arc 
not easily predicted. We do not always win at cards or dice, because 
the contingencies are so remotely determined that we call them 
“chance.” We do not always find good ice or snow when we go 
skating or skiing. Contingencies which require the participation of 
people are especially likely to be uncertain. We do not always get a 
good meal in a particular restaurant because cooks arc not always 
predictable. We do not always get an answer when we telephone a 
friend because the friend is not always at home. We do not always 
get a pen by reaching into our pocket because we have not always put 
it there. The reinforcements characteristic of industry and education 
are almost always intermittent because it is not feasible to control 
behavior by reinforcing every response. 

As might be expected, behavior which is reinforced only inter¬ 
mittently often shows an intermediate frequency of occurrence, but 
laborator)' studies of various schedules have revealed some surprising 
complexities. Usually such behavior is remarkably stable and shows 
great resistance to extinction. An experiment has already been men¬ 
tioned in which more than 10,000 responses appeared in the extinc¬ 
tion cur\’e of a pigeon which had been reinforced on a special 
schedule. Nothing of the sort is ever obtained after continuous re¬ 
inforcement. Since this is a technique for “getting more responses 
out of an organism” in return for a given number of reinforcements. 
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it is widely used. Wages are paid in special ways and betting and 
gambling devices are designed to “pay off” on special schedules be¬ 
cause of the relatively large return on the reinforcement in such a 
case. Approval, affection, and other personal favors are frequently in¬ 
termittent, not only because the person supplying the reinforcement 
may behave in different ways at different times, but preeisely because 
he may have found that such a schedule yields a more stable, per¬ 
sistent, and profitable return. 

It is important to distinguish between schedules which are arranged 
by a system outside the organism and those which are controlled by 
the behavior itself. An example of the first is a schedule of reinforce¬ 
ment which is determined by a clock—as when we reinforce a pigeon 
every five minutes, allowing all inter\'ening responses to go unre- 
inforccd. An example of the second is a schedule in which a response 
is reinforced after a certain number of responses have been emitted— 
as when we reinforce every fiftieth response the pigeon makes. The 
cases are similar in the sense that we reinforce intermittently in both, 
but subtle differences in the contingeneies lead to very different 
results, often of great practical significance. 

Interval reinforcement. If we reinforce behavior at regular intervals, 
an organism such as a rat or pigeon will adjust with a nearly constant 
rate of responding, determined by the frequency of reinforcement. If 
we reinforce it every minute, the animal responds rapidly; if every 
five minutes, much more slowly. A similar effect upon probability of 
response is characteristic of human behavior. How often we call a 
given number on the telephone will depend, other things being equal, 
upon how often we get an answer. If two agencies supply the same 
service, we are more likely to call the one which answers more often. 
We are less likely to see friends or acquaintances with whom we only 
occasionally have a good time, and we are less likely to write to a 
correspondent who seldom answers. The experimental results are 
precise enough to suggest that in general the organism gives back a 
certain number of responses for each response reinforced. We shall 
see, however, that the results of schedules of reinforcement are not 
always reducible to a simple equating of input with output. 

Since behavior which appears under interval reinforcement is espe- 
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cially stable, it is useful in studying other variables and conditions. 
The size or amount of each reinforcement affects the rate—more re¬ 
sponses appearing in return for a larger reinforcement. Different kinds 
of reinforcers also yield different rates, and these may be used to rank 

♦ 4 

rcinforccrs in the order of their effectiveness. The rate varies with the 
immediacy of the reinforcement: a slight delay between response and 
the receipt of the reinforcer means a lower over-all rate. Other vari¬ 
ables which have been studied under inteival reinforcement will be 
discussed in later chapters. They include the degree of deprivation 
and the presence or absence of certain emotional circumstances. 

Optimal schedules of reinforcement are often of great practical 
importance. They are often discussed in connection with other vari¬ 
ables which affect the rate. Reinforcing a man with fifty dollars at one 
time may not be so effective as reinforcing him with five dollars at 
ten different times during the same period. This is especially the case 
with primitive people where conditioned reinforcers have not been 
established to bridge the temporal span behveen a response and its 
ultimate consequence. There are also many subtle interactions be¬ 
tween schedules of reinforcement and levels of motivation, immediacy 
of reinforcement, and so on. 

If behavior continues to be reinforced at fixed intervals, another 
process inter\'enes. Since responses are never reinforced just after re¬ 
inforcement, a change, to be described in Chapter VII, eventually 
takes place in which the rate of responding is low for a short time 
after eaeh reinforcement. Tlie rate rises again when an intciv^al of 
time has elapsed which the organism presumably cannot distinguish 
from the interval at which it is reinforced. These changes in rate are 
not characteristic of the effect of wages in industry, which would 
otherwise appear to be an example of a fixed-interval schedule. The 
discrepancy is explained by the fact that other reinforcing systems 
are used to maintain a given level of work, as we shall see in Chap¬ 
ter XX\^. Docking a man for time absent guarantees his presence 
each day by establishing a time-card entry as a conditioned reinforcer. 
The aversive reinforcement (Chapter XI) supplied by a supervisor or 
boss is, however, the principal supplement to a fixed-interval wage. 

A low probability of response just after reinforcement is eliminated 
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with what is called variable-interval reinforcement. Instead of re¬ 
inforcing a response every five minutes, for example, we reinforce 
ever}' five minutes on the average, where the intervening inter\’al may 
be as short as a few seconds or as long as, say, ten minutes. Reinforce¬ 
ment occasionally occurs just after the organism has been reinforced, 
and the organism therefore continues to respond at that time. Its 
performance under such a schedule is remarkably stable and uniform. 
Pigeons reinforced with food with a variable interval averaging five 
minutes between reinforcements have been observed to respond for 
as long as fifteen hours at a rate of from two to three responses per 
second without pausing longer than fifteen or twenty seconds during 
the whole period. It is usually very difficult to extinguish a response 
after such a schedule. Many sorts of soeial or personal reinforeement 
are supplied on what is essentially a variable-interval basis, and ex¬ 
traordinarily persistent behavior is sometimes set up. 

Ratio reinforcement. An entirely different result is obtained when 
the schedule ot reinforcement depends upon the behavior of the or¬ 
ganism itself—when, for example, we reinforce everj' fiftieth response. 
This is reinforcement at a “fixed ratio”—the ratio of unreinforced to 
reinforced responses. It is a common schedule in education, where 
the student is reinforced for completing a project or a paper or some 
other specific amount of work. It is essentially the basis of profes¬ 
sional pay and of selling on commission. In industry it is known as 
piecework pay. It is a system of reinforcement which naturally recom¬ 
mends itself to employers because the cost of the labor required to 
produce a given result can be calculated in advance. 

Fixed-ratio reinforcement generates a very high rate of response 
provided the ratio is not too high. This should follow from the input- 
output relation alone. Any slight increase in rate increases the fre¬ 
quency of reinforcement with the result that the rate should rise still 
further. If no other factor intervened, the rate should reach the 
highest possible value. A limiting factor, which makes itself felt in in¬ 
dustry, is simple fatigue. The high rate of responding and the long 
hours of work generated by this schedule can be dangerous to health. 
This is the main reason why piecework pay is usually strenuously 
opposed by organized labor. 
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Another objection to this type of schedule is based upon the possi¬ 
bility that as the rate rises, the reinforcing agency will move to a 
larger ratio. In the laborator)’, after first reinforcing cvcr\ tenth re¬ 
sponse and then ever\’ fiftieth, we may find it possible to reinforce 
only every hundredth, although we could not have used this ratio in 
the beginning. In industry, the employee whose productivity has in¬ 
creased as the result of a piecework schedule may receive so large a 
weekly wage that the employer feels justified in increasing the number 
of units of work required for a given unit of pay. 

Under ratios of reinforcement which can be sustained, the behavior 
eventually shows a very low probability just after reinforcement, as it 
does in the case of fixcd-interxal reinforcement. The effect is marked 
under high fixed ratios because the organism always has “a long way 
to go” before the next reinforcement. Wherever a piecework schedule 
is used—in industr)', education, salesmanship, or the professions—low 
morale or low interest is most often obsciA'ed just after a unit of work 
has been completed. When responding begins, the situation is im¬ 
proved by each response and the more the organism responds, the 
better the chances of reinforcement become. The result is a smooth 
gradient of acceleration as the organism responds more and more 
rapidly. Tlie condition eventually prevailing under high fixed-ratio 
reinforcement is not an efficient over-all mode of responding. It 
makes relatively poor use of the available time, and the higher rates 
of responding may be especially fatiguing. 

Tlie laboratory study of ratio reinforcement has shown that for a 
given organism and a given measure of reinforcement there is a limit¬ 
ing ratio beyond which behavior cannot be sustained. The result of 
exceeding this ratio is an extreme degree of extinction of the sort 
which we call abulia (Chapter V). Long periods of inactivity begin 
to appear between separate ratio runs. This is not physical fatigue, as 
we may easily show by shifting to another schedule. It is often called 
“mental” fatigue, but this designation adds nothing to the obser\'ed 
fact that beyond a certain high ratio of reinforcement the organism 
simply has no behavior available. In both the laboratory study of 
ratio reinforcement and its practical application in everyday life, the 
first signs of strain imposed by too high a ratio are seen in these 
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breaks. Before a pigeon stops altogether—in complete ‘‘abulia”—it 
will often not respond for a long time after reinforcement. In the 
same way, the student who has finished a term paper, perhaps in a 
burst of speed at the end of the gradient, finds it difficult to start 
work on a new assignment. 

Exhaustion can occur under ratio reinforcement because there is 
no self-regulating mechanism. In interv’al reinforcement, on the other 
hand, any tendency toward extinction is opposed by the fact that 
when the rate declines, the next reinforcement is received in return 
for fewer responses. The variable-inteiA'al schedule is also self- 
protecting: an organism will stabilize its behavior at a given rate 
under any length of interval. 

Wc get rid of the pauses after reinforcement on a fixed-ratio 
schedule by adopting essentially the same practice as in variable- 
interval reinforcement: we simply vary the ratios over a considerable 
range around some mean value. Successive responses may be re¬ 
inforced or many hundreds of unreinforced responses may intervene. 
The probability of reinforcement at any moment remains essentially 
constant and the organism adjusts by holding to a constant rate. This 
“variable-ratio reinforcement” is much more powerful than a fixed- 
ratio scedule with the same mean number of responses. A pigeon may 
respond as rapidly as five times per second and maintain this rate for 
many hours. 

The efficacy of such schedules in generating high rates has long 
been known to the proprietors of gambling establishments. Slot ma¬ 
chines, roulette wheels, dice cages, horse races, and so on pay off on a 
schedule of variable-ratio reinforcement. Each device has its own 
auxiliary reinforcements, but the schedule is the important character¬ 
istic. Winning depends upon placing a bet and in the long run upon 
the number of bets placed, but no particular payoff can be predicted. 
The ratio is varied by any one of several “random” systems. The 
pathological gambler exemplifies the result. Like the pigeon with its 
five responses per second for many hours, he is the victim of an un¬ 
predictable contingency of reinforcement. The long-term net gain or 
loss is almost irrelevant in accounting for the effectiveness of this 
schedule. 
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A combined schedule. It is fairly easy to combine ratio and interval 
reinforcement in a laboratory experiment so that reinforcement is de¬ 
termined both by the passage of time and by the number of unrein¬ 
forced responses emitted. In sucli a case, if the organism is respond¬ 
ing rapidly, it responds many times before being reinforced, but if it 
is responding slowly, only a few responses occur before the next 
reinforcement. Such a schedule resembles either inter\'al or ratio re¬ 
inforcement, depending upon the values chosen in the combination, 
but there is some evidence that there is a middle ground in which 
neither schedule predominates and that the resulting behavior is un¬ 
stable. Although this combined schedule may seem quite arbitrary , it 
is exemplified by many social situations where, as we shall see in 
Chapter XIX, the reinforcing agent may be affected by the level of 
the behavior reinforced. 

We can reinforce an organism only when responses arc occurring 
at a specified rate. If we reinforce only when, say, the four preceding 
responses have occurred within two seconds, we generate a very high 
rate. I'his is maintained even when we reinforce only at varying in- 
terv'als with a fairly long mean interv'al. The rates exceed those which 
prevail under a variable-ratio schedule for the same net rate of re¬ 
inforcement. Reinforcing a low rate of responding at variable in- 
ter\'als has the opposite effect of generating a sustained low rate. 
These studies have yielded many facts, too detailed to be discussed 
here, which explain why a given schedule of reinforcement has the 
effect it has. The effects of a schedule are due to the contingencies 
which prevail at the moment of reinforcement under it. Such sched¬ 
ules are, in other words, simply rather inaccurate ways of reinforcing 
rates of responding. They are often the most convenient way of doing 
this, and this may explain their widespread use in the practical con¬ 
trol of behavior. But with proper instrumentation it should be pos¬ 
sible to improve upon established practices in all these fields. Thus 
gambling devices could be “improved”—from the point of view of 
the proprietor—by introducing devices which would pay off on a vari- 
able-inte^^'al basis, but only when the rate of play is exceptionally 
high. The device would need to be more complex than the slot ma¬ 
chine or roulette wheel but would undoubtedly be more effective in 
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inducing play. Schedules of pay in industry, salesmanship, and the 
professions, and the use of bonuses, incentive wages, and so on, could 
also be improved from the point of view of generating maximal pro¬ 
ductivity. 

Whether these improvements should be permitted is a matter to 
be discussed later. A schedule of reinforcement not only increases pro¬ 
ductivity, it also increases the interest, morale, and happiness of the 
worker. Any decision concerning a choice of schedules is complicated 
by this fact. In any event, we can act intelligently in this area only 
if we are in possession of clear-cut information regarding the nature 
and effect of the devices responsible for the maintenance of behavior 
in strength. We have much to gain from a close study of the results 
of experimental analyses. 



CHAPTER Yll 


OPERANT DISCRIMINATION 


DISCRIMINATIVE STIMULI 


Operant conditioning may be described without mentioning 
any stimulus which acts before the response is made. In reinforcing 
neck-stretching in the pigeon it was necessarj' to wait for the stretch¬ 
ing to occur; we did not elicit it. When a baby puts his hand to his 
mouth, the movement may be reinforced by the contact of hand 
and mouth, but we cannot find any stimulus which elicits the move¬ 
ment and which is present every’ time it occurs. Stimuli are always 
acting upon an organism, but their functional connection with oper¬ 
ant beha\’ior is not like that in the reflex. Operant behavior, in short, 
is emitted, rather than elicited. It must have this property if the 
notion of probability of response is to make sense. 

Most operant behavior, however, acquires important connections 
with the surrounding world. We may show how it does so in our 
pigeon experiment by reinforcing neck-stretching when a signal light 
is on and allowing it to be extinguished when the light is off. Even¬ 
tually stretching occurs only when the light is on. We can then 
demonstrate a stimulus-response connection which is roughly com¬ 
parable to a conditioned or unconditioned reflex: the appearance of 
the light will be quickly followed by an upward movement of the 
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head. But the relation is fundamentally quite different. It has a 
different history and different current properties. We describe the 
contingency by saying that a stimulus (the light) is the occasion upon 
which a Tespotise (stretching the neck) is followed by reinforcement 
(with food). We must specify all three terms. The effect upon the 
pigeon is that eventually the response is more likely to occur when 
the light is on. The process through which this comes about is called 
discrimination. Its importance in a theoretical analysis, as well as in 
the practical control of behavior, is obvious: when a discrimination 
has been established, we may alter the probability of a response 
instantly by presenting or removing the discriminative stimulus. 

Operant behavior almost necessarily comes under this kind of 
stimulus control, since only a few responses are automatically rein¬ 
forced by the organism’s own body without respect to external cir¬ 
cumstances. Reinforcement achieved by adjusting to a given environ¬ 
ment almost always requires the sort of physical contact which we 
call stimulation. The environmental control has an obvious biological 
significance. If all behavior were equally likely to occur on all occa¬ 
sions, the result would be chaotic. It is obviously advantageous that 
a response occur only when it is likely to be reinforced. 

The three-term contingencies which produce discriminative oper¬ 
ants are of many kinds. We develop the behavior with which we 
adjust to the spatial world because visual stimulation from an object 
is the occasion upon which certain responses of walking, reaching, 
and so on lead to particular tactual consequences. T^e visual field 
is the occasion for effective manipulatory action. The contingencies 
responsible for the behavior are generated by the relations between 
visual and tactual stimulation characteristic of physical objects. 
Other connections between the properties of objects supply other 
sorts of contingencies which lead to similar changes in behavior. 
For example, in an orchard in which red apples are sweet and all 
others sour, the behavior of picking and eating comes to be con¬ 
trolled by the redness of the stimulus. 

Tlie social environment contains vast numbers of such contin¬ 
gencies. A smile is an occasion upon which social approach will meet 
with approval. A frown is an occasion upon which the same approach 
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will not meet with approval. Insofar as this is generally true, ap¬ 
proach comes to depend to some extent upon the facial expression of 
the person approached. We use this fact when by smiling or frowning 
we control to some extent the behavior of those approaching us. 
The ringing of a telephone is an occasion upon which answering will 
be followed by hearing a voice. Tlie young child may pick up and 
speak into the telephone at any time, but eventually he will do so 
only when it has been ringing. The verbal stimulus “Come to dinner" 
is an occasion upon which going to a table and sitting down is 
usually reinforced with food. Tlie stimulus comes to be effective in 
increasing the probability of that behavior and is produced by the 
speaker because it does so. Bells, whistles, and traffic signals are other 
obvious occasions upon which certain actions are generally followed 
by certain consequences. 

Verbal behavior fits the pattern of the three-term contingency and 
supplies many illuminating examples. We learn to name objects by 
acquiring an enormous repertoire of responses each of which is appro¬ 
priate to a given occasion. A chair is the occasion upon which the 
response "chair” is likely to be reinforced, a cat is the occasion upon 
which the response "cat” is likely to be reinforced, and so on. When 
we read aloud, we respond to a series of visual stimuli with a series 
of corresponding vocal responses. The three-term contingency is evi¬ 
dent in teaching a child to read, when a given response is reinforced 
with "right” or "wrong” according to the presence or absence of the 
appropriate visual stimulus. 

Many verbal responses are under the control of verbal discrimina¬ 
tion stimuli. In memorizing the multiplication table, for example, the 
stimulus "9x9” is the occasion upon which the response "81” is 
appropriately reinforced, either by an instructor or by the successful 
outcome of a calculation. Historical "facts” and many other types 
of information fit the same formula. When the student writes an 
examination, he emits, insofar as it has become part of his repertoire, 
the behavior which is reinforced upon the special occasion established 
by the examination question. 

We use operant discrimination in two ways. In the first place, 
stimuli which have already become discriminative are manipulated in 
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order to change probabilities. We do this explicitly and almost con 
timiously when we direct constructive work, control the behavior of 
children, issue orders, and so on. We do it more subtly when we 
arrange stimuli whose effectiveness has not been specifically estab¬ 
lished for such purposes. In displaying merchandise in a large store 
the behavior of the customer is controlled through existing dis¬ 
criminative operants. The purchase of certain hpes of merchandise 
mav be assumed to be strongly determined by conditions which com- 
monlv bring customers to the store. It is a mistake to exhibit this 
merchandise in the front of the store, since the customer will then 
buy and leave. Instead, goods are displayed which are more likely 
to be purchased “on the spur of the moment” rather than as the 
result of deprivations sufficient to bring the customer into the store. 
I’lic display serves as a “reminder” in the sense of making the occa¬ 
sion optimal for the emission of weak behavior. 

In the second place, we may set up a discrimination in order to 
make sure that a future stimulus will have a given effect when it 
appears. Education is largely a matter of establishing such discrimina¬ 
tive repertoires, as we shall see in Chapter XXVI. We set up con¬ 
tingencies which generate behavior as the result of which children 
will look before crossing streets, will say “Tliank you” upon the 
proper occasions, will give correct answers to questions about his¬ 
torical events, will operate machines in the proper manner, will buy 
books, attend concerts, plays, and moving pictures identified in cer¬ 
tain ways, and so on. 


\ ObUNTARY AND INVOLUNTARY BEHAVIOR 

The relation between the discriminative operant and its controlling 
stimulus is verj' different from elicitation. Stimulus and response 
occur in the same order as in the reflex, but this does not warrant the 
inclusion of both types in a single “stimulus-response” formula. The 
discriminative stimulus does not elicit a response, it simply alters a 
probability of occurrence. The relation is flexible and continuously 
graded. The response follows the stimulus in a more leisurely fashion, 
and it may be intense or feeble almost without respect to the intensity 
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of the stimulus. This difference is at the root of the classical distinc¬ 
tion between \ohintai^' and involiintar\’ behavior. 

• • 

In the early history of the reflex, an effort was made to distinguish 
between reflexes and the rest of the behavior of the organism. One 
difference frequently urged was that a reflex was iiinate, but the 
principle of conditioning made such a distinction trivial. It was also 
said that reflexes were different because thev were unconscious. This 
did not mean that the individual could not report upon his own 
reflex behavior, but that the behavior made its appearance whether 
he could do so or not. Reflex action might take place when a man 
was asleep or otherwise “unconscious.” As as we shall sec in Chapter 
XVII, this too is no longer considered a \alid difference; behavior 
which is clearly not reflex may occur under such circumstances. A 
third classical distinction held that reflexes were not only innate and 
unconscious, but “involuntan.” They were not “willed.” The evi- 
dence was not so much that they could not be willed as that they 
could not be willed against. A certain part of the behavior of the 
organism cannot, so to speak, be helped. V\^e may not be able to 
keep from winking when something moves close to our eyes. We may 
not be able to help flinching at gunfire or salivating at the taste of a 
lemon or (through a conditioned reflex) at the sight of a lemon. 
Before the discoven' of the reflex such behavior was reconciled with 
a scheme of inner causation by postulating separate causes. It was 
attributed to seditious selves or foreign spirits temporarily invading 
the body. The involuntary sneeze, for example, revealed the presence 
of the Devil. (We still take the precaution of saying “God bless you” 
when someone sneezes.) With the advent of the notion of the reflex 
the issue of controllability became less crucial. 

In the present analysis we cannot distinguish between involuntary 
and voliintar)' behavior by raising the issue of who is in control. It 
does not matter whether behavior is due to a willing individual or a 
psychic usurper if we dismiss all inner agents of whatever sort. Nor 
can we make the distinction on the basis of control or lack of control, 
since we assume that no behavior is free. If we have no reason to dis¬ 
tinguish between being able to do something and doing it, such ex¬ 
pressions as “not being able to do something” or “not being able to 
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help doing something” must be interpreted in some other way. Wlien 
all relevant variables have been arranged, an organism will or will not 
respond. If it does not, it cannot. If it can, it will. To aslc whether 
someone can turn a handspring is merely to ask whether there are 
circumstances under which he will do so. A man who can avoid 
flinching at gunfire is a man who will not flinch under certain cir¬ 
cumstances. A man who can hold still while a dentist works on his 
teeth is one who holds still upon certain occasions. 

The distinction between voluntary and involuntary behavior is 
a matter of the kind of control. It corresponds to the distinction 
between eliciting and discriminative stimuli. The eliciting stimulus 
appears to be more coercive. Its causal connection with behavior is 
relatively simple and easily observed. This may explain why it was 
discovered first. The discriminative stimulus, on the other hand, 
shares its control with other variables, so that the inevitability of its 
effect cannot be easily demonstrated. But when all relevant variables 
have been taken into account, it is not difficult to guarantee the 
result—to force the discriminative operant as inexorably as the elicit¬ 
ing stimulus forces its response. If the manner in which this is done 
and the quantitative properties of the resulting relation warrant such 
a distinction, we may say that voluntary behavior is operant and 
involuntary behavior reflex. 

It is natural that the “will” as an inner explanation of behavior 
should have survived longer in the study of operant behavior, where 
the control exercised by the environment is more subtle and indirect. 
In the case of the operation we call reinforcement, for example, the 
current strength of behavior is due to events which have occurred in 
the past history of the organism—events which are not observed at 
the moment their effect is felt. Deprivation is a relevant variable, 
but one which has a history of which we may have little or no infor¬ 
mation. When a discriminative stimulus has an effect upon the 
probability of a response, we see that the present environment is 
indeed relevant, but it is not easy to prove the inevitability of the 
control without an adequate account of the history of reinforcement 
and deprivation. 

Consider, for example, a hungry guest who hears his host say. 
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“Won’t you come to dinner?’’ (We assume that the guest has under¬ 
gone the elaborate conditioning responsible for the behavior described 
as “knowing English.’’) As the result of respondent conditioning, 
this verbal stimulus leads to a certain amount of “involuntair ” sccre- 
tion of saliva and other gastric juices and perhaps contraction of the 
smooth muscles in the walls of the stomach and intestines. It mav 
also induce the guest to approach and sit down at the table, but this 
behavior is certainly of another sort. It appears to be less sharply 
determined, and we predict it less confidently. Both the salivary 
reflex and the operant response occur because they have usually been 
reinforced with food, but this histor)- lies in the past, much of it in 
the remote past. In the absence of an appropriate state of depriva¬ 
tion they may not occur; the guest may instead reply, “Thank you, 
I’m not hungry.’’ But even if the histoiy' of reinforcement and depri¬ 
vation is satisfactory', the operant responses may be displaced by 
other behavior involving the same musculature. If our guest has been 
offended by undue delay in the preparation of the meal, for example, 
he may take revenge by creating a further delay—perhaps by asking 
to wash his hands and remaining out of the room a long time. The 
behavior has been acquired because it has been reinforced by its 
damaging effect upon other persons—because the guest has “learned 
how to annoy people.” Before we can predict that he will come to 
the table as surely as we predict that he will salivate, we must have 
information about all relevant variables—not only those which in¬ 
crease the probability of the response but also those which increase 
the probability of competing responses. Since we ordinarily lack 
anything like adequate knowledge of all these variables, it is simpler 
to assume that the behavior is determined by the guest’s will—that 
he will come if he wants to and wills to do so. But the assumption 
is of neither theoretical nor practical value, for we still have to predict 
the behavior of the “will.” The inner explanation is no short cut to 
the information we need. If many variables are important, many 
variables must be studied. 

The distinction between voluntary and involuntary behavior, or 
operant and reflex behavior, parallels another distinction. Reflexes 
are primarily concerned, as we have seen, with the internal economy 
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of the organism, where glands and smooth muscles are most impor¬ 
tant. Reflexes employing the striped muscles are chiefly involved in 
maintaining posture and in other responses to the more stable 
properties of the surrounding world. This is the only area in which 
well-defined responses are effective enough to be acquired as part of 
the genetic equipment of the organism. Operant behavior, on the 
other hand, is largely concerned with that part of the environment 
in which the conditions for effective action are quite unstable and 
where a genetic or “instinctive” endowment is much less probable, 
if not actually impossible. 

Reflex behavior is extended through respondent conditioning and 
apparently cannot be conditioned according to the operant pattern. 
Glands and smooth muscles do not naturally produce the kinds of 
consequences involved in operant reinforcement, and when we 
arrange such consequences experimentally, operant conditioning does 
not take place. We may reinforce a man with food whenever he 
“turns red,” but we cannot in this way condition him to blush “vol¬ 
untarily.” The behavior of blushing, like that of blanching or secret¬ 
ing tears, saliva, sweat, and so on cannot be brought directly under 
the control of operant reinforcement. If some technique could be 
worked out to achieve this result, it would be possible to train a child 
to control his emotions as readily as he controls the positions of his 
hands. 

A result which resembles the voluntary control of glands or smooth 
muscles is achieved when operant behavior creates appropriate 
stimuli. If it is not possible to alter the rate of the pulse directly 
through operant reinforcement, other behavior—violent exercise, for 
example—can generate a condition in which the pulse rate changes. 
If we reinforce a certain critical rate, we may in fact, though inad¬ 
vertently, simply reinforce operant behavior which produces it. This 
effect appears to be the explanation of apparent exceptions to the 
rule. Cases have been reported in which a man could raise the hair 
on his arm “voluntarily.” Other subjects have been able to slow their 
pulse on command. But there is reasonable evidence for supposing 
that in every case an intervening step occurs and that the response of 
the gland or smooth muscle itself is not an operant. Other examples 
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in which an operant and a reflex are chained together in this way 
will be described in Chapter XV. 

It is not so easy to determine whether wc can condition purely 
reflex responses in striped muscles through operant reinforcement. 
The difficulty is that an operant response may arise which simply 
imitates the reflex. One may sneeze, for example, not only because 
of the pepper but because of special social consequences—“He only 
does it to annoy, because he knows it teases.” Whether the facsimile 
sneeze resembles the reflex response in ever)' particular is hard to say, 
but it probably does not. In any case, the controlling variables arc 
sufficiently different to warrant a distinction. The little boy who 
sneezes to annoy is unmasked when we set up conditions for incom¬ 
patible operant behavior. If wc offer him candy and the sneezing 
stops, we may be pretty sure that it was not reflex. We need not say 
that the sneezing must have been voluntar)- “because he could stop 
it when he wanted to.” A more acceptable translation reads, “He 
stopped sneezing when variables were introduced which strengthened 
competing behavior.” 

The distinction between voluntar)' and involuntary behavior is 
further complicated by the fact that the two muscular systems some¬ 
times overlap. The sphincters of the eliminative system and the 
muscles of the eyelid take part in certain well-known reflexes. In 
the young child the reflex control sometimes acts alone, but operant 
behavior is later acquired which may become powerful enough to 
oppose reflex action. Ordinarily, breathing is reflex, but we “volun¬ 
tarily” stop breathing under suitable conditions of operant reinforce¬ 
ment—for example, to win a bet or to escape the aversive stimulation 
of water in the nose when we dive. How long we stop will depend 
upon the strength of the breathing reflexes, which become more and 
more powerful as carbon dioxide accumulates in the blood. Even¬ 
tually a point is reached at which we “cannot help breathing.” 

The distinction between voluntary and involuntar)' behavior bears 
upon our changing concept of personal responsibility. We do not 
hold people responsible for their reflexes—for example, for coughing 
in church. We hold them responsible for their operant behavior— 
for example, for whispering in church or remaining in church while 
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coughing. But there are variables which are responsible for whisper¬ 
ing as well as for coughing, and these may be just as inexorable. 
When we recognize this, we are likely to drop the notion of responsi¬ 
bility altogether and with it the doctrine of free will as an inner 
causal agent. This may make a great difference in our practices. The 
doctrine of personal responsibility is associated with certain tech¬ 
niques of controlling behavior—techniques which generate a sense 
of responsibility” or point out ‘‘an obligation to society. These 
techniques arc relatively ill adapted to their purpose. Those who 
suffer arc the first to speak out for the inevitability of their be¬ 
havior. The alcoholic insists that he can’t help drinking and the 
“victim of a bad temper” that he can’t help kicking the cat or 
speaking his mind. We have ever\' reason to agree. But we can 
improve our understanding of human behavior and greatly strengthen 
our control by designing alternative practices which recognize the 
importance of reinforcement as well as other variables of which 
behavior is a function. 

DISCRIMINATIVE REPERTOIRES 

We have seen that any unit of operant behavior is to a certain 
extent artificial. Behavior is the coherent, continuous activity of an 
integral organism. Although it may be analyzed into parts for theo¬ 
retical or practical purposes, we need to recognize its continuous 
nature in order to solve certain common problems. Discriminative 
behavior offers many examples. In the behavior of reaching toward 
and touching a spot in the visual field, each position which the spot 
may occupy requires a particular combination of reaching and touch¬ 
ing movements. Each position becomes the distinguishing property 
of a discriminative stimulus which raises the probability of the appro¬ 
priate response. Eventually a spot in any position evokes the move¬ 
ment which achieves contact with it. At the very edges of the field 
the behavior may be defective, and unusual cases may need special 
conditioning—for example, reaching for an object seen in a mirror 
or from an unusual posture—but in the central area all positions of 
the spot comprise a continuous field and all possible combinations 
of movements leading to contact form a corresponding field. The 
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behavior is acquired upon specific occasions when specific responses 
toward specific locations are reinforced, but the organism almost 
inevitably acquires a coherent repertoire which can be described 
without referring to the punctate origins of the two fields. 

If we wish to specify the smallest possible unit of correspondence 
between stimulus and response, we use the dimensions in which the 
two fields are described. The correspondence is between points. But 
in many repertoires the minimal units fall considerably short of points 
in continuous fields. The stimuli and responses may not compose 
fields. When we learn the names of a large number of people, we 
do not expect either the visual patterns which the people present or 
their names to form continuous fields. The repertoire remains a col¬ 
lection of discrete units. Even when stimuli and responses can be 
described as fields, the behavior may not be developed to that point. 
In several of the discriminative repertoires now to be considered, the 
functional unit is much smaller than the stimulus or response which 
appears upon any given occasion and with which we characteristically 
deal, but it is by no means always so small as to be expressed as an 
instance of the correspondence between fields. 

Drawing from copy. Our behavior in response to the spatial field 
in which we live is so familiar that we are likely to forget how it is 
acquired. There are certain less familiar forms of behavior in which 
the origin of a discriminative repertoire can sometimes be clearly 
traced. In drawing “from copy”—or, less obviously, from an object— 
our behavior is the product of a set of three-term contingencies. A 
given line in the material to be copied is the occasion upon which 
certain movements with pencil and paper produce a similar line. All 
such lines and all such movements comprise fields, but the behavior 
may not reach a condition in which it can be dealt with as a field. 
This is easily seen in the behavior of the young child learning to 
draw. A small number of standardized responses are evoked by the 
highly complex stimulus field. The behavior of the skilled copyist is 
composed of a much larger number of responses and may seem as 
“natural” as our responses to spatial positions. It does not reach the 
point at which it comprises a continuous field if a given line in the 
copy is not reproduced exactly but rather with a characteristic 
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response in the “individual style” of the artist. An extreme case, in 
wliich behavior is divided into clearly identifiable discrete units even 
though tlie stimulus has the characteristics of a field, is the behavior 
of the electrical engineer who “draws a picture of a radio set using 

perhaps twcnt\' or thirty unit responses. 

I'hcrc arc great individual differences in the ability to draw from 
copy, d lie contingencies responsible for the behavior arc by no means 
so universal as those responsible for spatial behas'ior with respect to 
the visual field, and vers' different amounts of instruction are re¬ 
ceived by different individuals. Moreover, a small difference in early 
instruction may make a big difference in the csentual result, lire 
child who develops at an early age a repertoire with which he success¬ 
fully copies drass'ings and objects is likely to continue to use it and 
to receive further differential reinforcement. The special training of 
the artist includes many highly .sensitive differential contingencies, 
supi^licd by a teacher or automatically by the artist himself as he 
becomes “discriminating.” A man who cannot draw well is likely 
to be puzzled by one who can. He cannot sec “how it is done.” By 
no “effort of w'ill” can he produce a comparable achievement. The 
basic minimal repertoire is simply lacking. It can be established only 
through discriminati'-'c reinforcement. I he behavior is under the 
control of the copy, not of the artist, and until the copy has been 
put into control through differential reinforcement based upon it 
as a discriminative stimulus, the behavior will not occur. 

Singing or playing by ear. Draw'ing from copy is like responding to 
the spatial world insofar as both stimuli and responses approach 
continuous fields in the same way in both cases. In playing an instru¬ 
ment or singing a tune “by ear,” however, spatial dimensions are 
lacking. Here appropriate repertoires are set up by similar three-term 
cont ngcncies. A tone is the occasion upon which certain complex 
behavior in the vocal apparatus will be reinforced by generating a 
matching tone. The reinforcement is either automatic, depending 
upon previous conditioning of the singer with respect to good 
matches, or supplied by someone—an instructor, for example— 
whose behavior also reflects goodness of match. Such a repertoire may 
also include responses to intervals, each heard interval being the 
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occasion upon which a complex response generating a corresponding 
inteiAal is reinforced. Melodies, harmonic progressions, and so on, 
may form tlic bases for similar repertoires. 'Mic same kind of rela¬ 
tionships may go\ern tlie playing of a musical instrument, wliere tlic 
topography of the hcliavior which generates the tones or patterns is 
entirch- different. 

'i he ultimate unit in singing or playing hv ear may stop at the 
level of tlic half-tone scale. Both stimuli and responses usually show 
this “grain.” A singer with poor pitch is one whose response svstem 
lias a poorly defined grain which docs not match tlic stimulus system. 
On the other hand, a singer witli good pitch mav correctly sing a 
melody which is itself defective. Here the response repertoire is in 
better focus than the stimulus. 'I’lic half-tone scale is not. of course, 
a natural limit. I’hc successful vocal mimic has a repertoire which 
approaches a continuous field and which permits him to duplicate 
nonmusical sounds. I'hc successful imitation of bird song or of the 
noise of machines requires this .sort of fine-grained repertoire. 

W'c easily lose sight of the conditioning required to develop such 
behavior. I'he individual who cannot mimic an auditor^' pattern or 
who cannot sing or play by ear is likely to be puzzled by one who 
can. lie finds it quite impossible to sing a matching pitch or to hum 
a corresponding tunc or to imitate the noise of a locomotive, and he 
has no conception of how the successful mimic docs so. He cannot 
be a successful mimic by any “act of will.” The difference lies in 
the histories of reinforcement. If the repertoire with which one repro¬ 
duces a melody has never been established, it will not be brought into 
play by the appropriate circumstances. 

Imitation. It is only a short step from these discriminative reper¬ 
toires to the field of imitation. So far as we know, imitative behavior 
does not arise because of any inherent reflex mechanism. Such a 
mechanism would require that the stimulus generated by a given 
pattern of behavior in another organism elicit a series of responses 
ha\ing the same pattern—for example, the visual stimulus of a 
running dog would elicit running in another dog. This would be an 
extremely complex mechanism and, in spite of a strong belief to the 
contran,', it seems not to exist. Imitation develops in the histon' of 
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the individual as the result of discriminative reinforcements showing 
our same three-term contingency. The visual stimulation of some- 
one waving a hand is the occasion upon which waving a hand will 
probably receive reinforcement. The auditory stimulus “Da-Da"’ is 
the occasion upon which the complicated verbal response which pro¬ 
duces a matching auditor)' pattern is reinforced by the delighted 
parent. We see this sort of conditioning taking place in everyday 
life, and we can also set it up in the laboratory. For example, we can 
condition a pigeon to execute any one of several acts according to 
whether another pigeon is executing that particular act. When the 
imitatcc is pecking a key in a certain position, the imitator pecks a 
corresponding key. When the imitatee pecks a key in a different 
position, the imitator behaves accordingly. When the imitatee moves 
to the opposite side of the cage, the imitator follows. Such imitative 
behavior occurs only when specific discriminative reinforcement has 
taken place. Pigeons do not appear to imitate each other “naturally." 
The necessary three-term contingency often occurs in nature, how¬ 
ever. Thus, if a pigeon is scratching in a leaf-strewn field, this is an 
occasion upon which another pigeon is likely to be reinforced for 
similar behavior. The human parallel is not far distant. When we see 
people looking into a shop window, we are likely to look, too—not 
because there is an instinct of imitation, but because windows into 
which other people are looking are likely to reinforce such behavior. 
So well developed is the imitative repertoire of the average person 
that its origins are forgotten, and it is easily accepted as an inherent 
part of his behavior. 

Imitative repertoires are often developed in relatively discrete sets 
of responses. In learning to dance, a set of more or less stereotyped 
responses is acquired by virtue of which a step executed by the 
instructor is duplicated by the pupil. The good dancer possesses a 
large imitative repertoire of dance steps. When this repertoire is 
faulty, the imitation is poor, and the novice finds it very difficult to 
match a complicated step. In dancing, as in singing by ear, the 

imitative ability of a good performer seems almost magical to the 
untutored. 

A good actor possesses an imitative repertoire of attitudes, postures. 
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and facial expressions which enable him to follow the suggestions of 
a director or to duplicate behavior obser\'ed in evcr\day life. T he 
attempts of the unskilled actor may be ludicrously wide of the mark 
because the essential repertoire is lacking. Although imitative re¬ 
sponses approach a continuous field, that condition is probably never 
reached. T he duplication of the stimulus is often not precise, and 
the “grain” of the repertoire with which even the good mimic dupli¬ 
cates behavior may be apparent. 

The similarity of stimulus and response in imitation has no special 
function. We could easily establish behavior in which the “imitator” 
does exactly the oppsite of the “imitatec.” Our second pigeon could 
be conditioned to peck always in a different position. Something of 
this sort is involved in ballroom dancing where the behavior of 
instructor and pupil in an “imitative” repertoire are not the same. 
In ballroom dancing a step backward on the part of the instructor is 
the occasion for a step forward on the part of the pupil. This kind 
of inverse imitation can become as smooth as behavior having the 
same properties, as the good “follower” shows. 

Other noncorresponding repertoires are found in the field of sport. 
Tlie behavior of the tennis player is controlled in large measure by 
the behavior of his opponent, but the corresponding patterns are not 
imitative in the usual sense. There is, nevertheless, a three-term con¬ 
tingency: subtle stimuli from the behavior of the opponent which 
are correlated with a forthcoming placement of the ball are the 
occasion for appropriate defensive behavior. The good tennis player 
becomes extremely sensitive to this kind of stimulation, and it is 
only because of this that he is able to get into proper defensive 
positions. Fencing offers an especially good example of the integrated 
behavior of two individuals in which a response on the part of one 
constitutes a discriminative stimulus for a different response on the 
part of the other. The behavior may be as closely integrated as that 
of two dancers executing the same steps at the same time. 

These inverse “imitative” repertoires cannot approach continuous 
fields from which new instances will automatically emerge. To some 
extent, skilled dancers may improvise a dance in which one introduces 
a series of steps and the other follows, just as a tennis player is 
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to some extent automatically in possession of the proper reply to a 
new offensive maneuver, but the corresponding fields which provide 
for the duplication of behavior in true imitation are lacking. 

ATl’ENTION 

The control exerted by a discriminative stimulus is traditionally 
dealt with under the heading of attention. This concept reverses the 
direction of action by suggesting, not that a stimulus controls the 
behavior of an observer, but that the obsers'er attends to the stimulus 
and thereby controls it. Nevertheless, we sometimes recognize that 
the object “catches or holds the attention” of the obsen^er. 

What we usually mean in such a case is that the observer continues 
to look at the object. An animated billboard is dangerous, for ex¬ 
ample, if it holds the attention of a motorist too long. The behavior 
of the motorist in attending to the sign is simply the behavior of 
looking at it rather than at the road ahead of him. The behavior 
involves conditioning, and, in particular, the special conditioning of 
the discriminative operant. The variables are not always obvious, 
but they can usually be detected. The fact that people read bill¬ 
boards instead of looking at the surrounding countryside shows how 
effectively reading is usually reinforced—not only by billboards, but 
by stories, novels, letters, and so on. Powerful reinforcements are 
arranged by thousands of writers in every field of the written or 
printed word. All of these stimuli have common typographical 
properties, which induce the reading of new material. Some rein¬ 
forcement may also occur on the spot if the particular material is 
“interesting.” (We saw in Chapter VI that “taking an interest” is 
only another way of expressing the consequences of operant rein¬ 
forcement. ) 

We may study this relation in a simple experiment. We arrange 
to reinforce a pigeon when it pecks a key but only when a small light 
above the key is flickering. The pigeon forms a discrimination in 
which it responds to the key when the light flickers and not other¬ 
wise. We also note that the pigeon begins to watch the light. We 
might say that it is attending to it or that it holds its attention. The 
behavior is easily explained in terms of conditioned reinforcement. 
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Looking toward the light is occasionally reinforced by seeing the light 
flicker. The behavior is comparable to looking for an object (Chap¬ 
ter V). 

A steady orientation of the eyes is not the only possible result. 
The behavior of a lookout in the dark or in a heavy fog is an example 
of looking with orientation to the whole visual field. The bchax ior of 
searching the field—or responding to everx' part of it in some explora¬ 
tory' pattern—is the behavior which is most often reinforced by the 
discovery' of important objects; hence it becomes strong. W’c can 
usually obsciA'c that the behavior with which a child looks for a 
misplaced toy is specifically conditioned. If some patterns of looking 
arc reinforced by the discovery' of objects more often than others, 
they emerge as standard behavior. We may study this in the pigeon 
experiment by arranging a series of lights, any one of which may 
begin to flicker as a discriminative stimulus. I'hc pigeon comes to 
look at all the spots in a more or less random order. It may be said 
to be “looking for the flickering spot,” as in the example discussed in 
Chapter V. If the light begins to flicker while the pigeon is looking 
elsewhere, the flicker is seen at one side of the visual field. I’hc be¬ 
havior of looking directly toward the light is then optimally rein¬ 
forced. We say that the light “captures the undivided attention” of 
the bird. 

But attention is more than looking at something or looking at a 
class of things in succession. As everyone knows, we may look at 
the center of a page while “attending to” details at the edges. At¬ 
tempts to account for this in terms of “incipient eye movements” 
have failed; and in any case no comparable orientation appears to 
occur in attending to features of an auditory pattern. Thus, when 
we listen to a phonograph recording of a symphony while attending 
particularly to the clarinets, it is apparently not possible to demon¬ 
strate any special orientation of the ear. But if attention is not a 
form of behavior, it does not follow that it is, therefore, outside the 
field of behavior. Attention is a controlling relation —the relation 
between a response and a discriminative stimulus. When someone 
is paying attention he is under special control of a stimulus. We 
detect the relation most readily when receptors are conspicuously 
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oriented, but this is not essential. An organism is attending to a 
detail of a stimulus, whether or not its receptors are oriented to 
produce the most clear-cut reception, if its behavior is predominantly 
under the control of that detail. When our subject describes an 
object at the edge of the page even though we are sure he is not 
looking at it, or when he tells us that the clarinets have fallen a 
beat behind the violins, we need not demonstrate any spatial arrange¬ 
ment of stimulus and response. It is enough to point to the special 
controlling relation which makes such a response possible. Similarly, 
in our experiment, we can say that the pigeon is attending to the 
light, even though it is not looking at it, if it consistently makes 
the correct discriminative reaction—if it strikes the key when the 
light is flickering and does not strike it when the light is still. It 
will probably look at the light because the contingency responsible 
for the “attention” is also responsible for the reinforcement of such 
behavior, but it need not do so- 

When we enjoin someone to pay particular attention to a feature 
of the environment, our injunction is itself a discriminative stimulus 
which supplements the stimulus mentioned in controlling the be¬ 
havior of the observ'er. The observer is conditioned to look at or 
listen to a particular stimulus when he is told to “pay attention” to 
it because under such conditions he is reinforced for doing so. People 
generally say “watch that man” only when that man is up to some¬ 
thing interesting. They generally say “Listen to the conversation in 
the seat in back of you” only when something interesting is being 
said. 

Just as we may attend to an object without looking at it, so we 
may look at an object without attending to it. We need not con¬ 
clude that we must then be looking with an inferior sort of behavior 
in which the eyes are not correctly used. The criterion is whether 
the stimulus is exerting any effect upon our behavior. When we 
stare at someone without noticing him, listen to a speech without 
attending to what is said, or read a page “absent-mindedly,” we are 
simply failing to engage in some of the behavior which is normally 
under the control of such stimuli. 
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TEMPORAL RELATIONS BETW EEN STIMULUS. 

RESPONSE, AND REINEORCEMEN P 

The environment is so constructed that certain things tend to 
happen together. 1 he organism is so constructed that its behavior 
changes when it comes into contact with such an environment. 1 here 
are three principal cases. (1) Certain events—like the color and taste 
of ripe fruit—tend to occur together. Respondent conditioning is the 
corresponding effect upon behavior. (2) Certain activities of the 
organism effect certain changes in the environment. Operant condi¬ 
tioning is the corresponding effect upon behavior. (3) Certain events 
are the occasions upon which certain actions effect certain changes 
in the environment. Operant discrimination is the corresponding 
effect upon behavior. As a result of these processes, the organism 
which finds itself in a novel environment eventually comes to behave 
in an efficient way. The result could not be achieved by inherited 
mechanisms because the environment it not sufficiently constant from 
one generation to another. 

It is also characteristic of the normal environment that events 
occur together in certain temporal relations. A stimulus may precede 
another stimulus by a given intcr\'al, as when thunder precedes 
lightning. A response may produce a consequence only after a given 
interval, as when the ingestion of alcohol is followed by typical 
effects after a certain delay. A response may achieve its consequence 
when executed at a given time after the appearance of a discrimina¬ 
tive stimulus, as when a ball can be hit only by swinging at it after 
it has come within reach and before it goes out of reach. 

The first two of these characteristics raise no special problem. The 
effect of an interval of time between the stimuli in respondent condi¬ 
tioning is easily stated. If we give food to an organism ten seconds 
after a neutral stimulus has been presented, the process of condition¬ 
ing follows essentially the usual pattern: the dog salivates to the 
previously neutral stimulus. But eventually a temporal discrimination 
is established. The dog does not salivate when the conditioned 
stimulus is first presented but only after an interval has elapsed which 
gradually approaches the inteiA'al after which the unconditioned 
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stimulus usually appears. We may deal with this result simply by 
defining the conditioned stimulus as a given event plus the lapse of 
so many units of time. 1 he introduction of an interval of time be¬ 
tween response and reinforcer in operant conditioning is also of little 
interest here. 7'he effectiveness of the reinforcement is reduced, but 
the behavior is not otherwise greatly changed. 

When temporal properties are added to the three-term contingency 
of the discriminative operant, however, special effects follow. A 
response is sometimes reinforced only if it is made as rapidly as pos¬ 
sible after the appearance of a given stimulus. A contingency of this 
sort is responsible for the speed with which many people rush to 
answer the telephone. Picking up the telephone and saying “Hello" 
is reinforced only if the response is made quickly. The runner re¬ 
sponds to the starting gun in the same way for the same reason. In a 
typical “reaction-time" experiment a subject is instructed to lift a 
finger off a key as soon as a light has appeared or a tone has sounded, 
with the result that the behavior comes to occur “as soon as possible." 
Although the instructions given the subject in a reaction-time experi¬ 
ment or to the runner starting a race are complex, the effect upon 
behavior is due to the simple three-term contingency with an added 
temporal specification. This same contingency will cause a pigeon to 
behave “as quickly as possible” also. The pigeon’s reaction time is 
of approximately the same magnitude as man’s. 

A response may also be reinforced only if it is delayed by a given 
interval of time after presentation of the stimulus, llius, a pigeon 
is reinforced for pecking a key only if it waits, say, six seconds after 
the key is presented. Many social and commercial reinforcements are 
of this sort—where, for example, the net effect is reduced if one 
replies too quickly or agrees too readily to an arrangement or where 
an optimal reinforcement follows only after “due deliberation." 
Under contingencies of this sort, the maximal probability of response 

is characteristically reached a little before the required interval has 
elapsed. 

A characteristic effect of a delay is sometimes referred to as 
“expectancy" or “anticipation.” Let us suppose that a frequent visitor 
makes it a practice to give a child a bit of candy a few minutes after 
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arrival. How can we formulate the behavior of the child in “antici¬ 
pating” the gift of candv? W’c may note, first of all, that tlic arrival 
of the visitor scia'CS as a conditioned stimulus and that the cliild’s 
mouth will possibly water. If the intcr\al which elapses between the 
arrival and the presentation of candy is fairly uniform, a temporal 
discrimination may develop so that this conditioned response will 
not appear until the intcrsal has almost elapsed. If certain move¬ 
ments on the part of the visitor have usually preceded the presenta¬ 
tion of candy, any movement on the part of the visitor will be rein¬ 
forcing. 'I'hc child will therefore ‘'attend” to the \isitor, as that 
term has just been defined. He will watch the visitor closely. If any 
verbal stimuli have been especially correlated with the candy, he 
will also listen to whatever the visitor is saying, since listening will 
has’C been reinforced bv such stimuli. Anv behavior on the part of 
the child which has made the appearance of candy more probable 
has also been reinforced and will be strong. T he child may make 
himself conspicuous by “showing off,” for example. For the same 
reason he may refer to former gifts and thus supply a “hint” to the 
visitor (Chapter XV). 

Much of the child’s behavior will be emotional. It is easier to 
observe this when the “anticipated" stimulus is aversive. As we shall 
sec in Chapter XI, the emotional state in such a case is called 
“anxiety.” When the anticipated stimulus is positively reinforcing, 
there is a general change in the behavior of the child in the direction 
of greater excitement and responsi\'eness. These are to some extent 
the strengthening aspects of or “delight.” (We shall see in 

Chapter X that these terms must be used with caution.) 

There is still another ingredient in “anticipation.” The behavior 
of the runner in response to the words “Get ready, get set . . .” 
shows all the effects so far listed: (1) conditioned reflexes involving 
pulse, respiration, sweating, and so on, (2) a special controlling rela¬ 
tion to the voice of the starter which we call “close attention,” and 
(3) emotional changes which, if the race is to be a grueling one, will 
be more characteristic of anxiety than of joy\ In addition to all this, 
the runner tenses his muscles and adopts just that posture which 
will make his response to the signal “Go!” most effective. This kind 


.. S/'l 


.r 




128 


THE ANALYSIS OF BEHAVIOR 


of behavior, sometimes called “preparatory set,” is reinforced by the 
increased speed of the response which follows. The behavior may be 
nothing more than a partial execution of the response of “going,’" 
sometimes revealed in the false start, or it may consist of any other 
form of behavior which receives the net reinforcement of a more 
successful start—for example, holding still rather than rocking back 
and forth on one’s toes. 



CHAPTER Y||[ 


THE CONTROLLING 
ENVIRONMENT 


THE IMPORTANCE OF 1'HE ENVIRONMENT 

No matter what our philosophy of behavior may be, we are 
not likely to deny that the world about us is important. We may 
disagree as to the nature or extent of the control which it holds over 
us, but some control is obvious. Behavior must be appropriate to the 
occasion. Failure to keep in touch with reality leads to the kinds of 
difficulties often obser\'cd in psychotic behavior. Even when a man 
is engaged in rejecting the world, in systematically reducing certain 
forms of its control over him, he is physically interacting with it. 

Many theories of human behavior, nevertheless, neglect or ignore 
the action of the environment. The contact between the organism 
and the surrounding world is wholly disregarded or at best casually 
described. This is almost always true in clinical psycholog>% for 
example. The clinician often speaks of people, places, and things as 
“facts” entering into the interpretation of his patient's behavior, 
without further specifying their action. This practice may be adequate 
for certain purposes of communication, but it must be expected to 
fail at some point. Some of the problems of clinical psychology 
show that that point is often reached. A case history may inform us, 
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for example, that on a given day the patient saw an acquaintance 
wlio was approaching him cross the street, and this event may be 
regarded as significant in interpreting the patient’s behavior. But 
the report "X saw Y cross the street" does not prepare us for many 
possibly relevant questions. For example, what are the important 
properties of visual patterns which lead X to say, “That is Y”? Was 
X’s report of this event determined by a clear visual stimulus possess¬ 
ing these properties—in other words, was it really Y or did X merely 
“think it was Y”? In the latter case how plausible was the mistake? 
How much of the effect upon X was due to the appearance of Y as 
a person and how much to Y’s behavior in crossing the street? Upon 
what past occasions had similar stimuli affected X, and what condi¬ 
tioning had taken place with respect to people who cross streets, 
whether or not they were Y? To what extent was X’s reaction due 

4 

to a condition which we may describe bv saying that X was “afraid 
that Y was avoiding him"? Did earlier conditioning with respect to 
people wlio cross streets really involve Z, who resembles Y, and if 
so, mav we sav that Y was ser\ ing as a “symbol" for Z? 

Questions of this sort are frequently treated in the later discussion 
of a case history, but often they would not arise if the earlier analysis 
of the contact between organism and environment had been ade¬ 
quate. An improved analysis would mean, not necessarily more infor¬ 
mation in any particular instance, but rather an understanding of 
the wavs in which stimuli generally work. The casual account ignores 
many important points. 

TIIK ANAl.YSIS OF S'lIMULI 

In studying the extremely important independent variables which 
lie in the immediate environment, we may begin with a physical 
description. What is the stmeture of the world which we see, hear, 
touch, smell, and taste? We should not prejudge these events from 
their effects upon the organism. They are to be described in the 
usual terms of the physics of light and sound, the chemistry' of 
odorous or tasteful substances, and so on. We are interested, of 
course, only in conditions or events which have an effect upon 
behavior. The electromagnetie radiation of radio and television has 
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no effect upon the unequipped organism, except perhaps at vcr)' high 
energ)- levels. We do not say that the radiation is ‘'not a stimulus 
because it does not stimulate.” We simply ignore it just as we ignore 
the color of the apparatus we use in the study of mechanics as soon 
as we find it to be irrelevant. 

The kinds of events which stimulate the organism are effective 
only within certain limits. We hear sound, but only of certain 
pitches and intensities. We see light, but only of certain intensities 
and wave lengths. The limits of stimulation, and also the smallest 
differences in stimuli whieh make detectable differences in bcha\'ior, 
have been extensively investigated. The normal individual differs 
from the blind or color-blind in his reaction to visible radiation, 
from the deaf or partially deaf in his reaction to tones, from the 
anosmic in his reaction to odors, and so on. Smaller differences 
between normal individuals may be equally important. Research of 
this sort often emphasizes the action of the organ where the inter¬ 
change with the environment takes place—the eye, the ear, the taste 
buds in the tongue, and so on—but the whole organism may be 
involved. What appear to be simple sensory reactions often depend 
upon variables in the fields of conditioning, motivation, and emotion. 

Several important problems concerning stimulation are relatively 
independent of the particular physical properties of stimuli and of 
their range of effectiveness. In attacking these problems it does not 
matter whether the receiving organ is the eye or ear, for example, 
and we may work with values of stimuli which do not raise the prob¬ 
lem of limits. In discussing the stimulus functions of elicitation, 
discrimination, and reinforcement, it was not always necessary to 
specify' the nature of the stimulation, and we shall see in Chapter IX 
that this is also true of another function of stimuli in the field of 
emotion. There are even more general processes which may be 
studied not only without considering the particular form of energy 
exchange at the periphery of the organism, but also without specify¬ 
ing whether the stimuli are eliciting, discriminative, reinforcing, or 
emotional. In the following discussion the discriminative stimulus 
will be emphasized, but each process could presumably be demon¬ 
strated in the other functions as well. 
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INDUCTION 

When we have once brought behavior under the control of a given 
stimulus, we frequently find that certain other stimuli are also 
effective. If a pigeon has been conditioned to peck a red spot on the 
wall of the experimental chamber, the response will also be evoked, 
though not with the same frequency, by an orange or even a yellow 
spot. The property of redness is important, but not exclusively so. 
Spots of different shapes or sizes, or spots against different colors 
of background, also may be effective. To evaluate the full extent of 
the change brought about through reinforcement, we need to survey 
the effects of a large number of stimuli. The spread of the effect to 
other stimuli is called generalization or induction. The process sug¬ 
gests that a discrete stimulus is as arbitrary a notion as a discrete 
operant. The "identical elements" of a response have their parallels 
in the values or properties of a stimulus which are separately effec¬ 
tive. If we reinforce a response to a round, red spot one square inch 
in area, a yellow spot of the same size and shape will be effective 
because of the common properties of size and shape; a square, red 
spot of the same area will be effective because of its color and size; 
and a round, red spot half a square inch in area will be effective 
because of the common properties of color and shape. 

The effectiveness of a single property of a stimulus when combined 
with novel properties is shown when we are uneasy in the presence of 
a new acquaintance because he resembles someone whom we dislike. 
The very subtle property responsible for the resemblance is sufficient 
to arouse an emotional reaction. The Freudian argument that early 
emotional conditioning affects later personal adjustment presupposes 
such a process, in which the subtle property by virtue of which an 
acquaintance resembles one’s father or mother, for example, is said 
to be independently effective. The Freudian “symbol" presupposes 
the same process: a piece of abstract sculpture which generates an 
emotional response because it resembles the human body demon¬ 
strates the effectiveness of the property responsible for the resem¬ 
blance. As Freud pointed out, the resemblance may be effective 
whether or not it is recognized by the individual. 
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In literature the same process is exemplified by the device of 
metaphor. The emphasis in the usual rhetorical anah'sis is in\'ertcd, 
for the active control is assigned to the organism rather than to the 
stimulus. The speaker is said to transfer a description from one state 
of affairs to another which resembles it. We should say here that the 
metaphorical response is evoked by a stimulus which shares some of 
the properties of the stimulus to which the response is normally 
appropriate. Thus when Romeo compares Juliet to the sun, we need 
not suppose that he is engaging in an act of creative imagination; 
we need only suppose that Juliet's effect upon him shares some of 
the properties of the effect of the sun and that the verbal response 
"sun” is therefore strengthened. (The elaboration of the metaphor 
must be distinguished from an explanation of its ingredients. T he 
first step is to account for the appearance of the metaphorical term. 
This can usually be done by pointing to a property of a current 
stimulus which is possessed also by the customar)’ stimulus for the 
verbal response.) 

We check the importance of any dimension of a stimulus by 
examining the effect of different values. After building up a strong 
tendency to respond to a red spot, we may examine the rate of 
response during extinction to orange-red, orange, yellow-orange, and 
yellow. An experiment of this sort yields a generalization or induc¬ 
tion gradient. The responding during extinction is most rapid when¬ 
ever the spot is red. It is slightly slower to orange-red and much 
slower to yellow. An experimental animal such as the pigeon may 
not respond at all if the color is as different as, say, green, even 
though the two spots have common properties of shape, position, 
illumination, and being visual rather than, say, auditory stimuli. 
For the pigeon, therefore, color is obviously an important property. 
A color-blind organism, on the other hand, would not show this 
gradient; the rate would not change with color, if differences in 
brightness, texture, and so on were eliminated. Other properties 
of stimuli yield similar gradients when systematically explored. This 
procedure enables us to answer such a question as whether a given 
change in color is as important for the organism as a given change 
in size, or even whether color is as important a property of visual 
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stimuli as pitch is of auditor)' stimuli. Not all the dimensions of 
stimuli, however, are continuous in this way. 

DISCRIMINATION 

Induction (or generalization) is not an activity of the organism; 
it is simply a term which describes the fact that the control acquired 
by a stimulus is shared by other stimuli with common properties or, 
to put it another way, that eontrol is shared by all the properties of 
the stimulus taken separately. A particular combination of properties 
comprises what wc speak of as a stimulus, but the expression does not 
represent the control exercised by the environment very accurately. 

I'hc discrimination described in Chapter VII is also not a form 
of action on the part of the organism. When we establish a discrimi¬ 
nation between red and orange spots of light, we simply sharpen a 
natural gradient. By continuing to reinforce red spots while extin¬ 
guishing orange spots, the control of the property of redness is con¬ 
sistently strengthened, while that of the property of orange is con- 
sistcntlv weakened. In such an experiment, other properties of the 
stimuli—for example, size, shape, and location—are both reinforced 
and extinguished. Those who work with pigments, dyes, or other 
colored materials arc affected by contingencies in which slight differ¬ 
ences in color make a great deal of difference in the consequences of 
behavior. Wc say that they become “highly discriminating” with 
respect to color. But their behavior shows only processes of condi¬ 
tioning and extinction. 

ABSTRACTION 

Behavior may be brought under the control of a single property 
or a special combination of properties of a stimulus while being freed 
from the control of all other properties. The characteristic result is 
known as abstraction. The relation to discrimination may be shown 
by an example. By reinforcing responses to a circular red spot while 
extinguishing responses to circular spots of all other colors, we may 
give the red spot exclusive control over the behavior. This is dis¬ 
crimination. Since spots of other colors apparently have no effect. 
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it would appear that the other dimensions which they possess—for 
example, size, shape, and location—are unimportant. But this is not 
quite true, since it is less likely that the response will be made to a 
red object of another size and shape. We have, in other words, 
brought the response under the control of circular red spots but not 
of the “property of redness” alone. To achieve the latter, we must 
reinforce responses to many objects, all of which arc red, but which 
differ widely in their other properties. Eventually, the organism 
responds only to the property of redness. The case is exemplified by 
the verbal response “red.” It should be remembered, however, that 
a perfectly abstract response is probably never achieved. Stimuli 
which possess the required property but which arc quite extraordinary 
in other respects may not evoke the response. Stimuli without the 
required property which resemble especially common instances which 
possess it may also exert some control. 

Abstraction, too, is not a form of action on the part of the organ¬ 
ism. It is simply a narrowing of the control exercised by the 
properties of stimuli. The controlling property cannot be demon¬ 
strated upon a single occasion. In other words, a single instance 
of an abstract response will not tell us very much about its “referent.” 
The controlling relation can be discovered only through a survey of 
a large number of instances. 

We are likely to overlook the history' required for an abstract 
response, and we make many mistakes in interpreting behavior 
when we do so. When a child is taught to call a red ball red, we are 
surprised to find him calling a green ball red. In our own behavior, 
the response has long since come under the control of a particular 
color, but in the behavior of the child the properties of size, shape, 
and manipulability remain important until a program of differential 
reinforcement rules them out. 

An organism will not acquire an abstract response until a reinforc- 
ing agency sets up the required contingency. There are no “natural” 
contingencies which reinforce a response in the presence of a single 
property without respect to other properties. The necessary con¬ 
tingency apparently requires the mediation of other organisms. 
Abstraction, therefore, appears to have become possible only with 
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tlic development of verbal behavior. It does not follow that, if this 
was tlic case, abstract responses could never have arisen; for it is 
not impossible to conceive of events in a group of individuals which 
could have gi\'en rise to the rudiments of a verbal environment from 
which abstract verbal behavior could then have sprung. The matter, 
however, is highly speculative. 

\Vc arc in a better position to see how abstractions grow and 
change. Verbal behavior, perpetuated by the verbal community', has 
succeeded in isolating more and more subtle properties of nature. 
Sometimes we can watch this happen. Sometimes we can make 
plausible speculations as to how it might have happened. Etymolog)' 
often supplies valuable clues. TThe word “chance,” for example, 
comes from a word which referred to the fall of a die or coin. A 
conspicuous feature of such an event is the indeterminacy of the 
result, which is similar to the indeterminacy of other events in which 
nothing falls—for example, of the suit of a card drawn from a deck. 
The metaphorical transfer of the term for falling, on the basis of 
indeterminacy, is the first step in isolating this important property. 
The referent of the term is further refined—perhaps through cen¬ 
turies of changing practices in a verbal community—until in the 
hands of the modem mathematician the term comes under the 
control of a very special property of nature, the modem referent of 
the word “chance.” 

SOME TRADITIONAL PROBLEMS 
IN STIMULUS CONTROL 

Cross-modal induction. We sometimes find that a response is 
under the control of two stimuli which have no physical properties 
in common. If it has been conditioned to each of the stimuli 
separately, no explanation is required; but apparently this is not 
always the case. “Induction” appears to occur although common 
properties are lacking. Sometimes an intermediate connection can be 
discovered. Pins and pains are both called “sharp.” That sharp pins 
cause sharp pains may be relevant. It is only a short step from “the 
pin is sharp” to “the pain caused by the pin is sharp.” Once this 
verbal practice has been established in a community, the response is 
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usually learned separately in the two cases and is then no longer 
an issue. 

Common mediating behavior supplies another possible explana¬ 
tion. When Samuel Butler once saw the Wetterhorn, he caught 
himself humming an aria from Handel. “The big shoulder of the 
Wetterhorn seemed to fall just like the run on [the word) ‘shoul¬ 
der.’ ’’ Here an auditory response appears to have been made to a 
visual stimulus which in some wav resembled it. Presumably Butler had 
not heard the one while looking at the other; and we may suppose, 
for the sake of the example, that he had also not seen the musical 
phrase in visual form. We may account for the result if we assume 
that the two stimuli were capable of generating similar behavior. If 
Butler had learned to execute certain spatial responses to the “ups” 
and “downs” of pitch—say, in playing an instrument—and if, as the 
amateur artist he was, he had learned to respond to visual patterns 
with the copying responses described in Chapter \^II, then the two 
stimuli could have evoked a common form of behavior, self-stimula¬ 
tion from which might have scr\'ed as the basis for the response. The 
melodic line of the aria could have evoked a response which gener¬ 
ated stimulation often followed by the response “Wetterhorn.” Con¬ 
versely, the profile of the Wetterhorn could have evoked a response 
which in turn generated stimulation often followed by imitative hum¬ 
ming or the verbal response “Handel.” In this partieular instance 
the verbal response “shoulder” provides a clear cut example of 
mediating behavior. The shoulder of the mountain strengthens the 
verbal response “shoulder” which has been part of the auditory 
pattern of the aria. Speculation of this sort proves nothing, but it 
does suggest a possible solution of the problem of induction from 
one sensory field to another. An adequate solution would require an 
experimental analysis of the various auxiliary processes through which 
stimulus control can be extended. 

Responding to a relation. If an organism has been conditioned to 
choose a five-inch disk rather than a three-inch disk when the t^vo 
are presented together, it may choose a seven-inch disk if this is 
paired with the five-inch. This fact has frequently been offered as 
a criticism of the principle of the stimulus. If the five-inch disk is 
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the controlling stimulus, why is it not effective in the new combina¬ 
tion? Actually it is possible to condition an organism either to choose 
the larger of two objects or to choose a particular size no matter 
what the size of an accompanying object. Similar conditioning 
begins very early in the history of the indis'idual, and the behavior 
which predominates when a test is made will depend upon such a 
histoiy. "I hc relcitionul case is important in most environments. As 
the organism moves about in space, reinforcements are generally 
contingent upon relative, rather than absolute, size. 

Stimulus induction on the basis of a “relation” presents no diffi¬ 
culty in a natural science if the relation can be described in physical 
terms. Where this appears not to be the case, we have to turn to 
other possibilities—for example, the mediating behavior just dis¬ 
cussed. Even such relatively simple organisms as the pigeon may 
respond appropriately to new stimuli on the basis of relative size, 
relative intensity, relative position, and so on. They can also be con¬ 
ditioned to ignore any of these properties and to transfer a response 
on the basis of some other property. The relevant properties are all 
capable of physical specification. 

The “intcq>rctcd” stimulus. Another problem in stimulus control 
has attracted more attention than it deserves because of metaphysical 
speculations on what is “really there” in the outside world. What 
happens when an organism responds “as if” a stimulus had other 
properties? Such behavior seems to indicate that the “perceptual” 
world—the world as the organism experiences it—is different from the 
real world. But the difference is actually between responses—between 
the responses of two organisms or between the responses of one 
organism under different modes of stimulation from a single state 
of affairs. Thus I may “think” I have found my coat on the coat 
rack of a restaurant, though I discover upon examining the contents 
of the pockets that I am wrong. I may “think” that an object in the 
.sky is a plane only to see a moment later that it is a soaring bird. 
I may “think” that an object is square only to find when I shift my 
position that it is not. I may “think” that a spot of light has moved 
from one point to another, although an examination of the wiring 
circuit which has produced the spot convinces me that it merely 
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disappeared from one position and reappeared at the other. There 
is no reason to regard the first of each of these pairs of reactions as 
“perceptuar’ and the second as a form of contact with the real 
world, lliey are different responses made at different times to a 
common source of stimulation. 

Usually, objects arc capable of generating many different kinds of 
stimuli which are related to each other in certain ways. Responses to 
some forms of stimulation are more likely to be “right” than responses 
to others, in the sense that they are more likely to lead to effective 
behavior. Naturally these modes are favored, but any suggestion 
that they bring us closer to the “real” world is out of place here. 
As we saw in Chapter VII, the visual and tactual properties of 
objects in space lead us to develop an effective repertoire in which 
we approach and reach for objects successfully. To take a specific 
case, the visual stimuli generated by a square object arc usually 
accompanied by other visual stimuli when the object is seen from 
another angle or placed alongside measuring scales, as well as by 
certain tactual stimuli when the object is manipulated. Now, we 
can construct an object which, seen from a given point of view, 
supplies the stimulation characteristic of a square object, although 
it supplies ver)' different stimuli when handled, measured, or viewed 
from other angles. Once we have responded to such an object in 
apparently inconsistent ways, we may be less confident in saying 
"square” to any one set of visual stimuli, but we have no reason 
to argue that our original visual response was not to the object ‘ as 
it really is.” We operate in one world—the world of physics. Organ¬ 
isms are part of that world, and they react to it in many ways. 
Responses may be consistent with each other or inconsistent, but 
there is usually little difficulty' in accounting for either case. 

To take another example, suppose we observe a faint haze in the 
distance at the edge of a forest. This stimulus is appropriate to either 
of two large classes to which we emit the verbal responses “fog ’ and 
“smoke,” respectisely. The appropriate nonverbal responses are very' 
different: in one case we simply pass on; in the other we dash to 
give the alarm. We may do neither until we have “decided which 
it really is.” We “interpret” the stimulus before taking specific overt 



HO 


THE ANALYSIS OF BEHAVIOR 


action. But "interpretation" is like the "attention" discussed in 
Chapter \'II; we need not find a particular form of behavior to be 
identified with it. We "interpret” a stimulus as smoke insofar as we 
tend to respond with behavior appropriate to smoke. We interpret 
it as fog insofar as the probability of a different repertoire is increased. 
It is only when specific behavior has occurred that we can say that 
a stimulus has been “interpreted” in a given way, but we may still 
speak meaningfully of both probabilities. A given stimulus may have 
two different effects simultaneously when they are compatible, and 
two different effects in rapid alternation when they are not. A com¬ 
plex condition of indecision may prevail until the matter is resolved 
either by clarifying the stimulus or in some other way. (What hap¬ 
pens when we make a decision will be discussed in Chapter XVI.) 

'I’hc functional control exerted by a stimulus enables us to dis¬ 
tinguish between sensing and certain other activities suggested by 
such terms as "seeing.” "perceiving.” or "knowing.” "Sensing” may 
be taken to refer to the mere reception of stimuli. "Seeing” is the 
“interpretive” behavior which a stimulus controls. Xhe term seeing 
characterizes a special relation between behavior and stimuli. It is 
different from "sensing” just as responding is different from being 
stimulated. Our “perception” of the world—our "knowledge” of it 

_is our behavior with respect to the world. It is not to be confused 

with the world itself or with other behavior with respect to the world 
or with the behavior of others with respect to the world. 



CHAPTER 


DEPRIVATION AND SATIATION 


The discovery that part of the behavior of an organism was 
under the control of the environment led, as we have seen, to an 
unwarranted extension of the notion of the stimulus. Writers began 
to infer stimuli where none could be obser\ ed and to include various 
internal conditions in a “total stimulating situation. The principle 
of the stimulus was weakened by this extension and often abandoned 
in favor of other formulations of a less specific nature. It may be 
restored to usefulness in its proper sphere by distinguishing, as we 
have done, between the several functions of stimuli. We have now to 
note that some effects of the environment are not usefully classified 
as stimulation at all. When we deprive an organism of food, for 
example, we may stimulate it, but this is incidental to the main effect. 

DEPRIVATION 

We saw in Chapter III that the probability of drinking becomes 
\er^' high under severe water deprivation and veiy' low under exces¬ 
sive satiation. It is reasonable to assume that the probability always 
lies somewhere between these two extremes and that if the depriva¬ 
tion is changed, it simply moves toward one or the other. The 
biological significance of the change in probability is obvious. Water 
is constantly being lost through excretion and evaporation, and 
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an equal amount must be taken in to compensate for this loss. Under 
ordinary circumstances an organism drinks intermittently and main¬ 
tains a fairlv stcadv and presumably optimal state. When this inter¬ 
change is disturbed—when the organism is deprived of the oppor¬ 
tunity to drink—it is obviously important that drinking should be 
more likclv to occur at the first opportunity. In the evolutionar\^ 
sense this “explains” why water deprivation strengthens all condi¬ 
tioned and unconditioned behavior concerned with the intake of 
water. In a similar way we explain why an organism deprived of the 
opportunity to get rid of carbon dioxide breathes more rapidly and 
more deeply, why the feeding reflexes of the newborn baby grow 
more powerful as time elapses after feeding, and why a pet dog 
hovers about its feeding place in the kitchen as mealtime grows near. 

'I hc adaptive character of the increase in probability is sometimes 
expressed in another wav. Deprivation is said to disturb some kind 
of equilibrium which the strengthened behavior tends to restore, 
riic tendenev of living systems to maintain or restore equilibrium, 
which W. B. Cannon called homeostasis, has been of special interest 
to physiologists. The notion of equilibrium is compatible with a 
functional analysis, but the two should not be confused. A study of 
equilibrium may enable us to predict the direction in which behavior 
will change as the result of a change in an independent variable, 
but it will not tell us much more. Equilibrium is hard to define and 
c\en harder to observ'e and measure. A much more clear-cut program 
is to show how deprivation affects the probability of relesant be¬ 
havior, and this may be done without mentioning equilibrium. 

Not all deprivation or satiation is concerned with the conspicuous 
interchange of materials. A man may be “deprived of physical exer¬ 
cise” if he is kept indoors by bad weather; as a result he is especially 
likely to be active when the weather clears. Here deprivation consists 
merely of preventing the occurrence of behavior, and the emission 
of the behavior is itself satiating. Sexual satiation appears to be 
the result of the mere exercise of sexual behavior as well as of the 
special consequence known as the orgasm. Each mode of satiation 
must be dealt with in terms of the relevant economy of the organism 
and its biological significance must be interpreted accordingly. 
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Certain otlier kinds of operations which, as wc saw in Chapter III, 
have effects similar to deprivation and satiation arc conveniently 
included under the common heading of “motivation.” 

A given act of deprivation usually increases the strength of many 
kinds of behavior simultaneously. As the newborn baby goes unfed, 
reflex sucking increases in strength, and movements of the head in 
response to tactual stimuli at the checks and in the region of the 
mouth (by virtue of which the head is turned so that the breast is 
more readily received) become more vigorous. Eventually, many 
other forms of behavior are added to this group. Similarly, when an 
adult goes without water for a long time, a large group of operants 
are strengthened. Not only does he drink more readily when a glass 
of water is presented, he also will engage in many other activities 
which lead to the ingestion of water—going to the kitchen, operating 
a drinking fountain, asking for a glass of water, and so on. 

NEEDS AND DRIVES 

In traditional terms an organism drinks because it needs water, 
goes for a walk because it needs exercise, breathes more rapidly and 
deeply because it wants air, and eats ravenously because of the 
promptings of hunger. Needs, wants, and hungers, are good examples 
of the inner causes discussed in Chapter III. They are said to have 
various dimensions. Needs and wants arc likely to be thought of as 
psychic or mental, while hungers are more readily conceived of as 
physiological. But the terms are freely used svhen nothing with these 
dimensions has been obsers'ed. Sometimes the inner operation is 
inferred from the operation responsible for the strength of the be¬ 
havior—as when we say that someone who has had nothing to drink 
for several days “must be thirsty” and probably will drink. On the 
other hand, it is sometimes inferred from the behavior itself—as when 
we obsers'e someone drinking large quantities of water and assert 
without hesitation that he possesses a great thirst. In the first case, 
we infer the inner event from a prior independent variable and pre¬ 
dict the dependent variable which is to follow. In the second case, 
we infer the inner event from the event which follows, and attribute 
it to a preceding history of deprivation. So long as the inner event 
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is inferred, it is in no sense an explanation of the behavior and adds 
nothing to a functional account. 

Needs and wants are convenient terms in casual discourse, and 
many students of behavior have been interested in setting up similar 
hypothetical intciAcning states as legitimate scientific concepts. 
A need or want could simply be redefined as a condition resulting 
from deprivation and characterized by a special probability of re¬ 
sponse. Since it is difficult to lay the ghosts which hover about these 
older terms, there is a certain advantage in using a term which has 
fewer connotations. “Drive” is sometimes used. A drive need not 
be thought of as mental or physiological. The term is simply a con¬ 
venient way of referring to the effects of deprivation and satiation 
and of other operations which alter the probability of behavior in 
more or less the same wav. It is convenient because it enables us 
to deal with many cases at once. There are many ways of changing 
the probability that an organism will eat; at the same time, a single 
kind of deprivation strengthens many kinds of behavior. The con¬ 
cept of hunger as a drive brings these various relations together in 
a single term. 

The simplicity of the concept of drive is only apparent. This is 
true as well of need and want. No concept can eliminate an actual 
diversity of data. A drive is a verbal device with which we account 
for a state of strength, and it cannot answer experimental questions. 
We cannot control the behavior of an organism by directly changing 
its hunger, its thirst, or its sex drive. In order to change these states 
indirectly, we must deal with the relevant variables of deprivation 
and satiation and must face all the complexity of these operations. 

A drive is not a stimulus. A common belief is that deprivation 
affects the organism by creating a stimulus. The classic example is 
hunger pangs. Wlien an organism has been without food for a suffi¬ 
cient time, the contractions of the empty stomach stimulate it in a 
characteristic way. This stimulation is often identified with the 
hunger drive. But such stimulation is not closely correlated with the 
probability of eating. Hunger pangs are characteristic of only a small 
part of the range through which that probability varies continuously. 
We usually eat our meals without reaching the condition of depriva- 
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tion in which pangs are felt, and we continue to cat long after the 
first few mouthfuls have stopped any pangs which may have occurred. 
I'he attempt to find comparable stimulation in other drives has 
proved futile and occasionally even ludicrous. Dr\ncss of the throat 
does not var^' continuously with a tendency to drink through the 
entire range of deprivation. Any comparable stimulation under sexual 
deprivation is poorly correlated with the probability of sexual be¬ 
havior. In any case a drive, as defined above, cannot be a stimulus. 

A drive is not a physiological state. Certain internal conditions 
probably result from any given degree of deprivation. Adequate inde¬ 
pendent knowledge of them might enable us to dispense with a 
histoH' of deprivation in predicting behavior; but we are not likely 
to have such knowledge about a given organism at the moment 
when it would be useful in prediction; and we arc even less likely 
to be able to create such an appropriate state directly in order to 
control behavior. Insofar as we infer the state from the history- of 
deprivation or generate it by creating such a histor)', it is of no value 
in enabling us to dispense with that history'. Even when it is directly 
observed, it may still be useless in control. We have seen that in 
laboraton' research the weight of an organism is often used as an 
index of food deprivation. To maintain a given level of drive, the 
organism is kept at a given percentage of its weight when well fed. 
The weight is easily obscired, and as a fairly direct result of a history 
of deprivation it can generally be used as a substitute for such a 
histor\'. But since we change the weight only by changing the history, 
it cannot be used as a substitute in practical control. In any case, 
we do not assert that the weight of the organism is the hunger drive. 

A drive is not a psychic state. A parallel argument applies to the 
mental or psychic states with which drives are often identified. Here 
the possibility of independent evidence is more doubtful. What peo¬ 
ple “feel” when they are deprived of food, oxygen, and so on, will 
be considered in Chapter XVII. Since deprivation affects behavior, 
whether or not anything is “felt,” the feeling is not a secure basis 
for prediction. Direct manipulation of a psychic condition for pur¬ 
poses of control seems even more doubtful. 
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A drive is not simply a state of strength. A strong drive to chew 
gum ” is sometimes attributed to a person, not with reference to any 
liistor}' of deprivation, but simply because he tends to chew gum. 
It is possible that some relevant deprivation which would alter the 
tendency to chew gum could be uncovered, but no reference is made 
to such an operation in this use of the term. The possibility remains 
that the strength of the behavior is due to other kinds of variables 
not in the field of motivation. Other terms which often do nothing 
more than report the unusual strength of behavior are desire ( He 
has a strong desire to go to Europe”), “wish ( He wishes his father 
were dead"), and “complex” (“He has a sex complex”). The proba¬ 
bility of response may be due to many different kinds of variables, 
where deprivation plays a minor role. For example, the strong drive 
of the gambler, his gambling “complex,” or his “desire” to gamble 
may not be primarily due to a condition of deprivation at all, since 
a carefully arranged schedule of variable-ratio reinforcement will lead 
to a high probability of responding at a relatively low level of depri¬ 
vation. 

'11 IE PRACTICAL USE OF DRIVES 

Some examples of how behavior is actually controlled through 
deprivation and satiation will show how easily concepts referring to 
intervening states may be avoided. 

Deprivation is put to practical use when a child is made more 
likclv to drink milk by restriction of his water intake; when guests 
are induced to eat a modest meal with greater gusto by a delay in 
serving the meal; when the prisoner is made more likely to talk to 
interrogators by being put in “solitary” (“depriving him of talking 
as in the case of the “need for exercise” discussed above); when a 
population is made more likely to cooperate with the authorities 
who control food supplies by reducing rations; and when a child is 
kept interested in his toys by being given only one at a time. Opera¬ 
tions which have a similar effect are put to practical use when guests 
are induced to consume more cocktails at a party at which salty hors 
d’oeuvres are served, and when sexual behavior is intensified by the 
administration of certain hormones or aphrodisiacs. Extensive engi- 
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neering control is obviously necessar\’ to achieve some of these con¬ 
ditions for either tlicorctical or practical purposes. It is sometimes 
possible to use conditions which arise fortuitously. For example, 
waterfront brothels and other amusement enterprises take advantage 
of the deprivations suffered bv sailors at sea. Wartime shortages 
generate large-scale deprivations, and these are frequently exploited 
for both theoretical and commercial purposes. 

Satiation is put to practical use when a table d'hdte restaurant 
serves a large supply of good bread while a meal is being prepared in 
order to serse small portions of the rest of tlie meal without com¬ 
plaint (it is obviously a bad practice to ser\'e bread if the customer 
has still to order la carte); when an abundance of hors d’oeuvres 
is used to conceal the scantiness of the dinner which follows; when 
legalized prostitution is recommended on the ground that it reduces 
the probabilitv of sexual behavior in members of the population who 
might, if unsatiated, otherwise attack innocent women; when bread 
lines arc set up to reduce the violence which would otheirvise result 
from meager rations; and when a clinic reduces aggressive or other¬ 
wise undesirable behavior by giving the individual attention, approval, 
or even affection. An effect comparable to satiation is obtained when 
a drug is administered to reduce the probability of sexual behavior. 

All these examples could be described by reference to “drives.” 
We could say that the eating of salty hors d’oeuvres makes a guest 
thirstv and that his thirst then drives him to drink. It is simpler, in 
both theory’ and practice, to restrict ourselves to the fact that con¬ 
suming salty hors d’oeuvres leads to drinking. 

Tliese operations are not to be confused with operant conditioning 
through which behavior is brought under the control of a different 
deprivation. A government which offe; > a bonus for having a baby in 
a program designed to raise the birtli rate is not increasing the 
deprivation which controls procreation. By reinforcing the behavior 
of procreation with money, the behavior is brought under the control 
of a larger set of deprivations. The behavior can then be strengthened 
by depriving an individual of money or of any'thing money' will buy 
—as by severe taxation. The effect may be canceled by satiating the 
individual directly with money or indirectly with whatever money 
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will buy. Tliis might be done by an employer who responded to such 
a bonus by increasing wages in order to keep the families of his em¬ 
ployees small. So long as such a bonus is offered, an increase in 
relief or unemployment insurance may affect the birth rate. The level 
of sexual deprivation meanwhile has not necessarily been changed. 

SOME QUESTIONS CONCERNING DRIVE 

llow many drives are there? Is the maternal drive stronger than sex 
or hunger? Will satiating such a drive as hunger partially reduce a 
drive like sex? Can all drives be reduced to sex? Questions of this 
sort are more easily answered when restated in terms of deprivation 
and satiation. 

How many drives are there? The question has two translations. 
When we arc inferring drives from histories of deprivation, we may 
ask in how many ways an organism can be deprived. We can answer 
this only by exploration—by interfering with the exchange between 
organism and environment and obser\'ing the result. When we 
reduce the proportions of certain inert gases in the air breathed by 
the organism, we observe no change in its behavior. In such a case 
we do not speak of the "need” for such gases, or of any “drive” to 
get them. In translation, we do not list what we have done as an 
instance of deprivation. The fact that a gas has no biological value 
is irrelevant. We might deprive an organism of an essential food 
substance and still observe no change in its behavior, even though it 
might become ill or even die. The physiologist speaks of nutritional 
“needs,” but deprivation as here defined requires an effect upon be¬ 
havior. Our explorations would, of course, uncover many important 
cases, each of which might lead us to speak of a drive. 

A second translation is needed when we speak of a drive simply 
because the probability of behavior varies. TTie child who does not 
eat well is said to be suffering from anorexia—a lack of hunger. If he 
eats spasmodically, it is because his hunger is unpredictable—he is 
sometimes hungry and sometimes not. Here we use the concept of 
drive, not to refer to a history of ingestion, but simply to account 
(spuriously) for unexplained changes in probability, (Characteris¬ 
tically, we do not postulate a drive if the probability does not change. 

I 
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The reflex secretion of tears in response to irritation docs not var)' 
from moment to moment in anv wav which cannot otherwise be 
explained, and hence we do not speak of a drive to rid the eyes of 
foreign substances.) Our question thus becomes: Mow many kinds 
of behavior var\^ in strength independently of each other? On this 
basis we can distinguish between eating, drinking, sexual behavior, 
and so on, as well as between subdivisions of each of these fields. If 
the probabilities of eating two kinds of food always vary together, 
we assume a common hunger; but if at certain times an organism cats 
salt more readily than sugar and at other times sugar more readily 
than salt, we find it neccssar)' to speak of separate salt- and sugar- 
hungers. Presumably, separate operations of satiation and depriva¬ 
tion have accompanied these changes although they are not described 
by this use of the term “hunger.” 

What arc the drives of conditioned responses? Satiation and depri¬ 
vation arc obviously related to operant reinforcement. To a hungry 
organism food is both reinforcing and satiating. As we shall sec in 
Chapter XIV, it is ncccssaiA’, although sometimes difficult, to dis¬ 
tinguish between these effects. In reinforcement the presentation 
of food is contingent upon a response; we can satiate without con¬ 
sistently reinforcing if we avoid this contingency. We can also 
reinforce without substantial satiation or at least before satiation 
has taken place. But there is an inevitable connection between the 
two processes: the effect of operant reinforcement will not be ob- 
seiA'ed if the organism has not been appropriately deprived. The 
net result of reinforcement is not simply to strengthen behavior but 
to strengthen it in a given state of deprivation. Reinforcement thus 
brings behavior under the control of an appropriate deprivation. 
After we have conditioned a pigeon to stretch its neck by reinforcing 
with food, the variable which controls neck-stretching is food depri¬ 
vation. The response of stretching the neck has merely joined that 
group of responses which vav}' with this operation. We can describe 
the effect of reinforcement in no simpler way. 

By conditioning and extinguishing a response under different 
degrees of deprivation, it is possible to see the effect of deprivation 
in detail. If we reinforce a response in a group of organisms at the 
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same Icxcl of depri\'ation and extinguish it in subgroups at different 
lc\cls. we find that the number of responses in the extinction cur\'e 
is a function of deprivation. The hungrier the organism, the more 
responses it will emit during extinction. If, on the other hand, we 
condition at different levels of deprivation and extinguish at the 
same level, we find, surprisingly enough, that the two extinction 
curses contain approximately the same number of responses, nie 
effect of deprisation is felt during extinction, not during condi¬ 
tioning. 

Behavior which has been strengthened by a conditioned reinforcer 
varies with the deprivation appropriate to the primary' reinforcer. 
I'he bchas'ior of going to a restaurant is composed of a sequence of 
responses, carlv members of which {for example, going along a 
certain street) are reinforced by the appearance of discriminative 
stimuli wliich control later responses (the appearance of the restau¬ 
rant. which we then enter). The whole sequence is ultimately rein¬ 
forced bv food, and the probability varies with food deprivation. 
\Vc increase the chances that someone will go to a restaurant, or 
even walk along a particular street, by making him hiingiy . \Vc do 
not sav that there arc special drives associated with the early re¬ 
sponses in the sequence, because there are no parallel operations of 
deprivation. Such traditional tenns as “needs,” “wants,” and so on 
recognize these subsidiary steps. For example, we might say that a 
man first warits a taxi, that he then wants the driver to take him to 
FiftV'Sixth Street, that he then wants to find a particular restaurant, 
that he then wants to open the door, that he then wants a table, a 
menu, and the roast beef. But since there are no processes of satiation 
and deprivation appropriate to the behavior which is involved here, 
except for the last item, we have no reason to set up corresponding 
driNCS. A man docs not need a taxi in the sense of not having had a 
taxi for a long time. Certain behavior which requires a taxi for its 
execution is strong and occurs as soon as a taxi is available. The 
appearance of the taxi reinforces any behavior which brings it about. 
It is also an enabling event which makes a later response possible and 
hence brings the earlier behavior to an end. It would only confuse 
the issue, however, to say that the appearance of the taxi had satiated 
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the behavior of hailing taxis. The practical use of the relation reveals 
its essentials. If for some reason we want to induce a man to hail a 
taxi, we strengthen any behavior requiring a taxi; we do not deprive 
him of taxis. lie will not hail a taxi if he already has one because 
other behavior then intcr\'enes. 

Generalized reinforcers raise this issue in a more acute form. Tliey 
are important precisely because they are effective under a number of 
deprivations, some of which arc likely to be present at any given 
time. The lack of a specific deprivation encourages us to assume a 
separate drive for the immediate generalized reinforcer. Although 
we may be willing to give up the notion of a “taxi drive,” we arc 
likely to insist upon a drive for attention, approval, affection, domina¬ 
tion, or money. In order to justify assigning separate drives to the 
behavior so reinforced, we should have to show that it is possible to 
deprive or satiate an organism with given amounts of attention, 
approval, and so on, but we should also have to make sure that no 
satiation or deprivation is taking place in any of the primary areas 
associated with the generalized reinforcer. For example, we should 
have to reduce a “need for affection” by supplying an abundance of 
affection without supplying any of the primary reinforcers associated 
with it. Only then would we have evidence of an autonomous drive. 
But although generalized reinforcers may reinforce when primary 
reinforcement is not forthcoming—a case exemplified by the be¬ 
havior of the miser in poring over his gold—we have no reason to 
assume a corresponding drive. It is one of the more obvious charac¬ 
teristics of the miser that he is not actually satiated by money. The 
reinforcing effect of money is extraordinarily great, so that most of 
his behavior which is strong is strong for that reason, but a separate 
drive implies a separate operation of deprivation or satiation, for 
which we have little evidence in the behavior of the miser. There are 
other kinds of misers who specialize in attention, affection, approval, 
or domination. Although we may show that they are strongly rcin- 
foTced by these generalized reinforcers, even in the absence of pri¬ 
mary reinforcement, we do not speak of separate drives because there 
are no appropriate operations of deprivation or satiation. 

The drives appropriate to conditioned reinforcers are not to be 
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confused with acquired drives for nicotine, alcohol, morphine, or 
other drugs. The effects induced by drugs of this sort reinforce the 
behavior of consuming them. T he drug may bring release from some 
a\ ersive condition such as anxiety, fear, or a sense of guilt (Chapter 
XI), or it niav produce some condition which is positively reinforc¬ 
ing. riic reinforcement may become more and more powerful if 
repeated use leads to physiological changes which increase the 
aversive condition which the drug reduces. This sort of addiction 
is an acquired drive for which well-marked processes of deprivation 
and satiation arc evident. A potent technique of control is the devel¬ 
opment of an addiction. A drug is administered repeatedly until its 
reinforcing power becomes great. It is then used to reinforce desired 
behavior—for example, the behavior of a prisoner of war in answering 
questions. 'Hie drug is then withheld, and the probability of the 
behavior increases greatly. 

In Chapter V we saw that an event could be a positive reinforcer 
even though it did not reduce a level of deprivation. There is a 
related point to be made here: behavior which is strengthened 
through deprivation need not reduce that deprivation. The Freudian 
process of sublimation raises this issue. Through either stimulus or 
response induction an operation which strengthens a response also 
strengthens other responses having similar properties or the same 
response upon similar occasions. Deprivation is an example of such 
an operation. Tims a childless couple may “sublimate" their parental 
behavior by treating a pet dog as a child. The artist “sublimates” 
sexual behavior in working on pictures or models of the human body. 
If we believe that behavior always takes place “for good reason”— 
that is, because of some conceivable biological advantage—many 
instances of this sort seem puzzling. But a response strengthened 
through induction may very' well have no effect upon the deprivation, 
even though the response from which it borrows its strength does 
have such an effect. In many examples of sublimation the behavior 
itself is automatically satiating. 

Are drives interrelated? There is another area in which it is 
advantageous to deal with the processes of satiation and deprivation 
rather than with any drive. Efforts have been made to reduce all 
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motivation to one priman^ drive. Freud, for example, emphasized 
sex. The contention that a given activitv is “essentially sexual in 
nature” may be translated in cither of two ways depending upon 
whether we emphasize the dependent or the independent variable. 
To say that artistic and musical activities “express sexual impulses” 
mav mean that characteristic behavior in this field resembles sexual 
behavior in topography. The sculptor modeling a human figure is 
behaving to some extent as he would behave toward a human body; 
certain temporal aspects of musical behavior resemble the temporal 
pattern of sexual behavior. This is simply induction from one 
stimulus to another or from one response to another on the basis of 
similaritv. But it is often difficult to decide whether two situations 
or two actions are similar enough to warrant such an explanation. 
Often we have to infer the importance of a point of similarity from 
its effect upon behavior. On the other hand the issue may be ex¬ 
pressed in a question of this form: Does the probability of an act 
which is asserted to be sexual in nature change with sex deprivation 
or satiation? If so, it may be regarded as sexual even though it is not 
topographically similar to obviously sexual behavior. 

An alternative contention is that the basic human drive is 
“domination.” This generalized reinforcer is certainly very' important. 
The more specific biological reinforcers are frequently received only 
after precurrent behavior has been effective in “dominating” the 
physical or social environment, and to this extent we may bring all 
behavior together under the rubric of domination. We have seen, 
however, that a corresponding drive is not required when the rein- 
forcer is generalized. Domination may be reinforcing and hence very 
important as a controlling variable. A man may come to dominate 
“for the sake of dominating,” just as the miser collects money for 
its own sake. But apparently there is no independent deprivation 
or satiation concerned with domination itself. To deprive a man of 
domination would mean to arrange circumstances in which he 
dominated neither physical nature nor society, but under such cir¬ 
cumstances he would presumably suffer other deprivations, to which 
any general strengthening of his behavior could then be attributed. 
Conversely, when we change a man's behavior by “letting him have 
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his own way,” we may appear to be satiating his *^need for domina¬ 
tion,” but we almost certainly also change some primary deprivations 
or some of the aversive conditions to be described in Chapter XI. 
The surprisingly general effect of many specific satiations or depriva¬ 
tions makes the generality of the drive to dominate questionable. A 
man who tends to dominate in many walks of life may undergo an 
extensive change as the result of a successful marriage or, on a shorter 
time scale, a satisfying meal. 

Attempts to reduce all human motivation to a single need for 
approval, affection, and so on, are subject to the same criticism. 

Which drive is strongest? Is the maternal drive stronger than sex? 
Is sex stronger than hunger? We might answer questions of this sort 
by bringing some arbitrarily chosen response under the control of 
different deprivations (by reinforcing it in different ways) and then 
observing the maximal frequency under extreme values of each. How 
docs the rate at which an extremely hungry male rat emits a response 
which is reinforced with food on a given schedule compare with the 
rate of the same rat under extreme sexual deprivation when the 
response has been reinforced on the same schedule with access to a 
receptive female? But there is little point in comparing deprivations 
unless situations arise naturally in which the relative magnitudes of 
their effects arc important. By depriving an organism of both food 
and sexual contact, we can observe which behavior emerges when 
appropriate stimuli are presented together. These conditions are not 
easily satisfied, however. Many organisms suffering severe water depri¬ 
vation cannot eat diy' food; when we limit the ingestion of water, 
therefore, we create an effect similar to that of satiation with food. 
In the same way, sexual behavior is weakened when an organism is 
severely deprived of food for a long time. 

TIME AS A VARIABLE 

The mere emission of behavior is sometimes satiating, and we then 
“deprive” the organism simply by making the behavior impossible. 
As we have seen, the “need for exercise” shows this pattern: the 
organism confined within narrow limits is more than usually active 
when the limits are first removed. The behavior which ensues reduces 
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the level of activity as a form of satiation. W'hen the behavior is 

possible at all times, it shows a periodicity. If a rat is confined in a 

small cage and given continuous access to a running-wheel, its 

behavior in the wheel ma\ be taken as a fair measure of its activity. 

# • 

A rat usually alternates between active and inactive phases with 
considerable regularity. A similar periodicity is seen when an inter¬ 
change with the environment is not restricted—as in eating, drinking, 
or behaving sexually under conditions of unlimited opportunity. 
When the period can be established, we may use time as an inde¬ 
pendent variable in predicting the behavior. 

A fairly drastic periodic change is exemplified by sleeping and 
waking. During sleep, much of the activity of the organism reaches 
an extremely low point. This is not all that happens, however. We 
may conveniently regard sleep as a special form of behavior which 
occurs periodically and with fair regularit)' in the lives of most organ¬ 
isms. Usually, the periodicity coincides with the night-day cycle, 
with obvious advantages. We deprive an organism of sleep by pre¬ 
venting the behavior—for example, we keep it on a slowly revolving 
platform where it must move constantly in order to keep from fall¬ 
ing into a tank of water. I'he tendency to sleep increases as a function 
of this deprivation. Just as we induce a child to eat more readily at 
mealtime by making sure that he does not eat between meals, so we 
induce him to go to bed at night by making sure that he does not 
sleep during the day. To some extent we may also satiate an organ¬ 
ism with sleep. We do this when we send a child to bed early to 
prepare him for a particularly long or exhausting day. Under unre¬ 
stricted conditions, the periodicity of sleeping and waking permits 
us to use time as a variable in predicting behavior. 

Time appears to be the principal experimental variable in certain 
slower periodic changes. Behavior during the menstrual cycle is an 
example. Tliis may be altered by administering hormones or in other 
ways, but our principal opportunity to predict a given response lies 
in studying such cyclic changes. Strength cannot be changed by 
interfering in a cycle, as in activity or sleep, because the periodicity is 
not the result of automatic deprivation and satiation. Time as a 
variable cannot be manipulated experimentally. 
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Many behavioral changes, especially in the instinctive behavior of 
lower organisms, follow an annual cycle. Migratory patterns, for 
example, coincide fairly accurately with the seasons of the year. Some 
condition var\ing with time may be more important than time itself. 
Wc can interfere with the normal periodicity by, so to speak, chang¬ 
ing the season—by keeping the organism at a temperature or length 
of day characteristic of a different time of year. If the behavior 
responds to the unscasonal condition, the mere passage of time can 
scarcely be the primary variable. Under normal conditions the time 
of year may be an important bit of information. 

When changes in behavior extend over longer periods, we speak 
of the independent variable as the age of the organism. A response 
may appear at a given age and later disappear. The increase in proba¬ 
bility as a function of age is often spoken of as maturation. We 
achieve some degree of prediction by discovering these developmental 
schedules. Various forms of so-called instinctive behavior, especially in 
species other than man, usually appear at characteristic ages, and the 
age may be our only useful variable. Since these changes are usually 
not cyclic, prediction must be made on the basis of information 
obtained with other organisms. Individual differences may be great; 
we cannot predict accurately when an individual will engage in a 
certain kind of sexual behavior by establishing the average age of 
onset in a population. Usually, therefore, practical problems of this 
kind are not solved by appeal to schedules of maturation. Certain 
instructional procedures are most effective when a child is ready for 
them, but in planning an educational program for young children 
chronological age may be of little value in determining readiness. 
The presence or absence of the relevant behavior may have to be 
determined by direct observation of each child. 

THE INDIVIDUAL AND THE SPECIES 

At any given time in its life, an individual displays certain be¬ 
havior in certain states of probability. This is the background against 
which we study selected operants and explore the effects of inde¬ 
pendent variables. These variables are seldom relevant in accounting 
for the existence of the behavior chosen for study; they merely affect 
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its probability. Its existence is taken for granted. W'hcn we examine 
different individuals, however, we find certain differences in behavior 
—in tlieir repertoires, in the frequencies witli which gi\en responses 
arc emitted, and in tlic extent to which the behavior responds to 
reinforcement, deprivation, and other operations. Between species 
these differences may be verv large. 'I'hc concept of “instinct” has 
been used to account for tlicm. Behavior wliich is cliaracteristic of 
a species is attributed to an instinct (of uncertain location or proper¬ 
ties) said to be possessed bv all members of the species. I’his is a 
flagrant example of an cxplanator\' fiction. "I’hc term, like “drive,” 
may be given respectable scientific status by being defined as a 
tendency to respond in a way which is characteristic of a species, but 
so defined it cannot be used as an explanation. If the instinct of nest- 
building refers only to the obseiAcd tendency of certain kinds of 
birds to build nests, it cannot explain why the birds build nests. 

A tendency of the members of species to behave in a certain wav 
is no more remarkable than a tendency to exhibit certain features of 
anatomy and internal physiology’. Behavior is as much a part of the 
organism as are its anatomical features. Species-status itself is a 
variable to be taken into account in evaluating the probability of any 
kind of behavior. Since we cannot change the species of an organ¬ 
ism, the variable is of no importance in extending our control, but 
information about species-status enables us to predict characteristic 
behavior and, in turn, to make more successful use of other tech¬ 
niques of control. 

The problem of individual differences within the species must be 
solved in the same way. If we are interested in sexual behavior, for 
example, we cannot make use of probabilities characteristic of a 
species unless we know where our subject stands in the population. 
The individual capacity or level of ability is the same kind of datum 
as species-status itself. We arrive at species-status as a relevant 
variable by surveying the incidence of a particular form of behavior 
in the species; we arrive at the position of the individual in the species 
by a similar survey of characteristic tendencies. The problem of indi¬ 
vidual differences will be discussed again in Chapter XIII. 
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SUMMARY 

We may summarize the kinds of independent variables considered 
in this chapter by listing the questions which we must answer in 
order to account for the probability of a response. 

1. Is the behavior in question characteristic of the species to which 

the individual belongs? 

2. If so, is the current age of the individual within the range in 
which the behavior is observ'ed? 

3. If the behavior varies considerably between individuals, what 
is the relative position of the individual we are studying? 

4. If the behavior shows any long-range cyclic change, what is the 
current position of the individual in the cycle? If the cycle can be 
shown to correspond to a change in some external condition for 
example, the mean temperature—this variable may permit a more 
explicit prediction and may possibly be useful in control. 

5. If the behavior shows cyclic changes on a smaller scale—for 
example, a diurnal change—at what time are we to predict or control 
the response? If we are dealing with a nocturnal animal, for example, 
and if the day-night cycle is a part of our experimental conditions, 

then we must note the time of day. 

6. What is the history of the individual with respect to sleep? If 
there has been no interference with sleep, what is the present point 
in the cycle? If the organism has been deprived of or satiated with 
sleep, how has this been done? 

7. What is the history of the organism with respect to relevant 
deprivations and satiations? If the behavior in which we are interested 
is conditioned, to what deprivation was the reinforcement related? 
What is the recent history of this deprivation? In studying behavior 
which is characteristically reinforced with food, we must have some 
record of the history of ingestion or some contemporary measure, 
such as body weight, which varies with that history. We must also 
know whether any variable in the recent history of the organism—for 
example, the administration of a drug—has had an effect similar 
to that of deprivation or satiation. 

There are other variables of which the behavior may be a function. 
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Reinforcement has not been included in the list, and \vc have still 
to consider other variables in the fields of emotion, aversive stimula¬ 
tion, and punishment. All in all, therefore, the list may seem disheart- 
eningly long. In actual practice, however, many of these conditions 
are easily arranged. In routine laborator)' research it is not difficult to 
set up a procedure which assures considerable stability from day to 
day with respect to most or all of them. We can then study a very* 
few variables at a time. In practieal applications as well, many of the 
points which have just been raised prove to be trivial. The effective 
variables are easily isolated. 



EMOTION 


WHAT IS AN EMOTION? 

The “emotions” are excellent examples of the fictional 
causes to which we commonly attribute behavior. We run away 
because of “fear” and strike because of "anger”; we are paralyzed by 
“rage” and depressed by “grief.” These causes are in turn attributed to 
events in our history or present circumstances—to the things which 
frighten or enrage us or make us angry or sad. The behavior, the 
emotion, and the prior external event comprise the three links of our 
familiar causal chain. The middle link may be taken to be either 
psychic or physiological. In the psychic case, it is argued that an ex¬ 
ternal circumstance makes an individual feel emotional and that the 
feeling leads him to take appropriate action. The famous James- 
Lange theory—developed by the American psychologist William 
James and the Danish physician C. G. Lange—asserted, however, 
that one did not feel the inner cause of emotion, but simply some 
part of the emotional behavior itself. James cast this assertion in 
classical form by saying “that we feel sorry because we cry, angry 
because we strike, afraid because we tremble, and not that we cry, 
strike, or tremble because we are sorry, angry, or fearful, as the case 
may be.” This theory emphasized the study of the physiological 
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changes which we “feel” in emotion and to some extent identified 
the psychic middle link with the physiological. The most obvious 
changes which arc present when the layman says he “feels an emo¬ 
tion” arc the responses of smooth muscles and glands—for example, 
blushing, blanching, weeping, sweating, salivating, and contracting 
the small muscles in the skin which produce goose flesh in man and 
elevate the fur of animals. Manv of these arc familiar in the form 
recorded by the “lie detector,” which detects, not dishonesty, but 
the emotional responses generated when the individual engages in 
behavior for which he has previously been punished. 

In spite of extensive research it has not been possible to show that 
each emotion is distinguished by a particular pattern of responses of 
glands and smooth muscles. Although there are a few characteristic 
patterns of such responses, the differences between emotions are 
often not great and do not follow the usual distinctions. Nor are such 
responses diagnostic of emotion in general, since they also occur 
under other circumstances—for example, after heavy exercise or in a 
chill wind. 

Certain responses executed by the facial and postural muscles are 
commonly said to “express” emotion. Laughing, growling, snarling, 
baring the teeth, and the muscular responses which accompany the 
secretion of tears are examples. The lower organisms generally have 
a more extensive repertoire of this sort. Emotional expressions can 
be imitated by operant behavior, as in the theater, and are frequently 
modified by the social environment to conform to cultural specifica¬ 
tions. To some extent a given culture has its own way of laughing, its 
own cries of pain, and so on. It has not been possible to specif)^ given 
sets of expressive responses as characteristic of particular emotions, 
and in any case such responses are not said to be the emotion. 

In the search for what is happening “in emotion” the scientist has 
found himself at a peculiar disadvantage. Where the layman idem 
tifies and classifies emotions not only with ease but with considerable 
consistency, the scientist in focusing upon responses of glands and 
smooth muscles and upon expressive behavior has not been sure that 
he could tell the difference between even such relatively gross emo¬ 
tions as anger and fear. Some means of identification available to the 
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layman appears to have been overlooked. The layman does not say 
that a man is angr>' simply because the small blood vessels enlarge so 
that he becomes red or because his pulse accelerates, or because cer¬ 
tain muscles set his jaw and lips in a position reminiscent of the snarl 
of the uncivilized animal. All of this may happen “without emotion,” 
and the layman frequently judges a man to be angry when he has no 
knowledge of such responses whatsoever—for example, when he says 
that the writer of a letter must have been angry when he wrote it. 
He knows that a companion is afraid as he walks with her through a 
dark street even though he does not see her turning pale or know 
that the secretion of her digestive juices has been suppressed or that 
her pulse has accelerated. Under other circumstances all of this might 
be happening when he would not call her afraid at all. 


EMOTION AS PREDISPOSITION 


When the man in the street says that someone is afraid or angry 
or in love, he is generally talking about predispositions to act in cer¬ 
tain ways. The “angry” man shows an increased probability of strik¬ 
ing, insulting, or otherwise inflicting injury and a lowered probability 
of aiding, favoring, comforting, or making love. The man “in love” 
shows an increased tendency to aid, favor, be with, and caress and a 
lowered tendency to injure in any way. “In fear” a man tends to 
reduce or avoid contact with specific stimuli—as by running away, 
hiding, or covering his eyes and ears; at the same time he is less likely 
to advance toward such stimuli or into unfamiliar territory. These 
are useful facts, and something like the layman's mode of classifica¬ 
tion has a place in a scientific analysis. 

The names of the so-called emotions serve to classify behavior with 
respect to various circumstances which affect its probability. The 
safest practice is to hold to the adjectival form. Just as the hungry 
organism can be accounted for without too much difficulty, although 
“hunger” is another matter, so by describing behavior as fearful, 
affectionate, timid, and so on, we are not led to look for things called 


emotions. The common idioms, “in love,” “in fear,” and “in anger. 


suggest a definition of an emotion as a conceptual state, in which a 
special response is a function of circumstances in the history of the 
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individual. In casual discourse and for many scientific purposes some 
such way of referring to current strength in terms of the variables of 
which it is a function is often desirable. But so defined, an emotion, 
like a drive, is not to be identified with physiological or psychic 
conditions. 

THE RFSPONSKS WHICH VARY 
TOGEI HER IN EMOTION 

We have no guarantee that the vocabular\' of the layman will 
survive unchanged in a scientific study. In the following discussion, 
however, terms taken from casual discourse arc used to refer to famil¬ 
iar observ'ations and to point up certain essential problems. 

Some emotions—joy and sorrow, for example—involve the whole 
repertoire of the organism. \Vc recognize this when we say that an 
emotion is exciting or depressing. Some emotions involve the whole 
repertoire, but in more specific ways. Probably no behavior remains 
unchanged when the organism becomes afraid or angr}% but responses 
related to specific features of the environment (the “object” of the 
fear or anger) arc especially affected. Some of the milder emotions, 
such as embarrassment, sympathy, and amusement, may be localized 
more narrowly in small subdivisions of a repertoire. 

Responses which var)- together in an emotion do so in part because 
of a common consequence. The responses \s’hich grow strong in anger 
inflict damage upon persons or objects. This process is often biologi¬ 
cally useful when an organism competes with other organisms or 
struggles with the inanimate world. The grouping of responses which 
define anger thus depends in part upon conditioning. Behavior which 
inflicts damage is reinforced in anger and is subsequently controlled 
by the conditions which control anger. Just as food is reinforcing to 
a hungr)' organism, so damage inflicted upon another is reinforcing 
to an angry one. Just as a hungry man exclaims “Good!” when he 
receives food, so the angrj' man exclaims “Good!” when his opponent 
is damaged in any way. 

Some of the behavior involved in an emotion is apparently uncon¬ 
ditioned, however, and in that case the grouping must be explained 
in terms of evolutionary consequences. For example, in some species 
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biting, Striking, and clawing appear to be strengthened during anger 
before conditioning can have taken place. Tliese responses generate 
cries of pain and other evidences of damage which then reinforce 
other responses to bring them within the class of “angry behavior.’' 
For example, if an angry child attacks, bites, or strikes another child 

_all without prior conditioning—and if the other child cries or runs 

away, then these same consequences may reinforce other behavior of 
the angr>' child which can scarcely be innate—for example, teasing 
the other child, taking toys away from him, destroying his work, or 
calling him names. The adult possesses a full-fledged repertoire of 
obviously conditioned verbal responses which inflict injury, all of 
which are strong “in anger” and co-vary with unconditioned behavior 
as a function of the same variables. 

EMOTIONAL OPERATIONS 

We discover the variables of which emotional states are a function 

_QS wc discover any variables—by looking for them. Many cases are 

familiar. A sudden loud noise often induces “fear.” Continued physi¬ 
cal restraint or other interference with behavior may generate “rage.” 
Failure to receive an accustomed reinforcement is a special case of 
restraint which generates a kind of rage called “frustration.” Behavior 
which has frequently been punished may be emitted in a form called 
“timid” or “embarrassed.” We must not expect too much, however, 
from these ever^'day terms. They have grown out of circumstances 
which emphasize typical cases and have never been tested under 
conditions which require precise definition. Even an apparently well- 
marked emotion like anger may not be reducible to a single class of 
responses or attributable to a single set of operations. The anger 
produced by one circumstance may not be the same as that pro¬ 
duced by another. Again, the interruption of an established sequence 
of responses usually has an emotional effect, but when one cannot 
write a letter because a pen is missing or cannot open a door because 
it is bolted on the other side or cannot converse with someone who 
is totally deaf or does not speak the same language, the resulting 
effects may differ in as many ways as the circumstances differ. To 
group them all together as “frustrating conditions” and to describe 
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all tlie changes in behavior as “rage” is a misleading simplification. 
I'lic recognition of mixed emotions suggests that the usual classifica¬ 
tion makes distinctions which do not always correspond to the facts. 

The subtle emotions are still more difficult. The condition which 
the layman calls loneliness, for example, appears to be a mild form 
of frustration due to the interruption of an established sccjucnce of 
responses which have been positively reinforced by the social environ¬ 
ment. The lonclv man has no one to talk to. No matter where he 
turns, powerful behavior has no chance to be effective. Loneliness 
which is due to the absence of a single person who has supplied rein¬ 
forcement in the form of affection may be especially profound, as the 
lovesick individual demonstrates. The loneliness of the amiable man 
who finds himself among strangers for a long time will be of a dif¬ 
ferent character. A child lost in a large crowd suffers in still a different 
way: all the behavior which has been previously reinforced bv the 
appearance of his mother or father now fails; he looks about but docs 
not see them; he calls and cries, but they do not answer. Depending 
upon a variety of circumstances, the result may be close to fear or 
rage or sorrow. At the moment there appears to be no over-all classi¬ 
fication which will be applicable to all these examples. 

We have noted that the fields of motivation and emotion are very 
close. They may, indeed, overlap. Any extreme deprivation probably 
acts as an emotional operation. The star^'ing man is almost necessar¬ 
ily frustrated and afraid. Nostalgia includes both a drive and an 
emotion. If we remove a man from his characteristic surroundings, 
a large part of his social behavior cannot be emitted and may there¬ 
fore become more and more probable: he will return to his old sur¬ 
roundings whenever possible and will be particularly “sociable” when 
he docs so. Other parts of his behavior become strong because they 
are automatically reinforced under the prevailing deprivation; he will 
talk to anyone who will listen about his old surroundings, his old 
friends, and what he used to do. This is all a result of deprivation. 
But nostalgia is also an emotional condition in which there is a gen¬ 
eral weakening of other forms of behavior—a “depression,” which 
may be quite profound. We cannot classify this as the result of 
deprivation because the behavior which is thus affected has not been 
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specifically restrained. Distinctions of this sort may seem a little 
forced, but they are worth making whenever we are interested in 
understanding or altering such conditions. 

THE TOTAL EMOTION 

We define an emotion—insofar as we wish to do so—as a particular 
state of strength or weakness in one or more responses induced by 
any one of a class of operations. We may make as many distinctions 
as we wish between separate emotions, although this endeavor usually 
exhausts itself in the endless number of distinctions which are actu¬ 
ally possible. Methods and practices are available for surveying the 
effects of any given operation in which we may be interested, and a 
statement of the relation appears to leave nothing of importance out 
of account. The reflex responses which accompany many of these 
states of strength are not to be completely disregarded. They may not 
help us to refine our distinctions, but they add characteristic details 
to the final picture of the effect of a given emotional circumstance. 
In describing the fact that criticism of his work "makes an employee 
mad," for example, we may report: (1) that he turns red, that the 
palms of his hands sweat, and, if the evidence is available, that he 
stops digesting his lunch; (2) that his face takes on a characteristic 
"expression" of anger; and (3) that he tends to slam doors, to kick 
the cat, to speak curtly to his fellow workers, to get into a fight, and 
to watch a street fight or boxing match with special interest. The 
operant behavior under (3) appears to hang together via a common 
consequence—someone or something is damaged. Tlie "total emo¬ 
tion"—if this is of any importance—is the total effect of the criticism 
of his work upon his behavior. 

The so-called phobias provide extreme examples. Phobias are gen¬ 
erally named after the circumstances which give rise to the emotional 
condition: in claustrophobia, for example, a possibly violent change 
in behavior is the result of confining the organism in a small space; 
in agoraphobia a similar effect follows from placing the organism in 
a large, open space. Many phobias are generated by more specific 
circumstances: a man with otherwise normal behavior may show an 
excessive fear of dead birds, for example. How should we describe the 
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latter “emotion”? We could probably show that the unexpected sight 
of a dead bird elicits veiy^ considerable reflex responses—blanching, 
s^veating, change of pulse rate, and so on. as well as various expres¬ 
sions executed by the musculature of the face and body. If this were 
the extent of the phobia, we could give a complete description of it 
as a set of conditioned reflexes evoked by sight of a dead bird, but 
there are other important effects. The behavior of escape will be ver}' 
powerful. Some of this—such as turning or running away—may be 
unconditioned or conditioned veiy^ early in the history' of the organ¬ 
ism. Some of it—calling upon someone to take the bird away, for 
example—is obviously of later origin. The rest of the repertoire under¬ 
goes a general change. If our subject was in the course of eating his 
dinner, we observe that he stops eating or eats less rapidly. If he was 
engaged in some other task, we obser\^c a change which might be 
described as “losing interest.” We see that he is more likely to jump 
at sudden noises and to look about him cautiously upon entering new 
territory. He will be less likely to talk at a natural rate, to laugh, to 
joke, and so on. He will be predisposed to “see” a dead bird in place 
of an old hat lying on the ground, in the sense that this stimulus, 
which to some extent resembles a dead bird, may reinstate all the 
emotional conditions just described. These changes may persist for a 
considerable period of time after the stimulus has been removed. A 
complete account of the phobia would need to refer to all of them, 
and this would obviously require a description of the whole behavorial 
repertoire of the individual. 

EMOTIONS ARE NOT CAUSES 

As long as we conceive of the problem of emotion as one of 
inner states, we are not likely to advance a practical technology. It 
does not help in the solution of a practical problem to be told that 
some feature of a man’s behavior is due to frustration or anxiety; we 
also need to be told how the frustration or anxiety has been induced 
and how it may be altered. In the end, we find ourselves dealing with 
two events—the emotional behavior and the manipulable conditions 
of which that behavior is a function—which comprise the proper 
subject matter of the study of emotion. 
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There arc certain cases in which three separate stages can be iden¬ 
tified. A chronic emotional condition sometimes leads to certain 
forms of illness. For example, a man whose business is failing may be 
subject to a long scries of circumstances which generate a chronic 
condition of frustration or anxiety. Part of the total emotion may be 
reflex responses in the alimentar)' tract, as a result of which the man 
may become physically ill—he may develop ulcers, for example. Here 
it is legitimate to attribute the illness to an “emotion” as a cause, 
because we define the emotion as a pattern of behavior. We might in 
the same way attribute a cracked skull to emotion if the injury- was 
suffered as the result of reckless behavior. But this is ver>- different 
from arguing that emotional behavior is due to an emotion. A man 
does not neglect his business because of anxiety or wor^^^ Such a 
statement is at best merely a way of classifying a particular kind of 
neglect. The only valid cause is the external condition of which the 
behavior of neglect, as part of an emotional pattern known as anxiety 
or worry, can be shown to be a function. A similar neglect which 
might be attributed to a preoccupying love affair would not be “due 
to a different emotion,” it would simply be the effect of a different 
set of circumstances. In order to remedy the neglectful behavior in 
either case, we must attack the external circumstances which are 
responsible for it. 

The behavior observed during an emotion is not to be confused 
with emotion as a hypothetical “state,” any more than eating is to be 
confused with hunger. An angry man, like a hungry man, shows a 
disposition to act in a certain way. He may never act in that way, 
but we may nevertheless deal with the probability that he will do so. 
Just as we infer from a history of deprivation that a man is probably 
hungry even though he is unable to eat, so we infer that he is prob¬ 
ably angry by showing that he generally behaves in an angry fashion 
upon similar occasions. Just as we infer that a man is hungry from 
his preoccupation with displays of food, so we infer that he is angry 
because of relatively unimportant responses which co-vary in that 
emotion. In neither of these cases need our subject emit the impor¬ 
tant ultimate behavior for which he is predisposed. 

The layman makes a further distinction between an emotion and 
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a predisposition toward emotion. Me speaks of tlie latter as a mood 
when the state is temporar)’ (“He is in a jolly mood”) and as a 
disposition when it is of longer standing (“lie has a mean disposi¬ 
tion”). Moods and dispositions represent a kind of second-order 
probability—tlie probability that a given circumstance will raise the 
probability of a given response. 

THE PRACTICAL USE OE EMOMON 

Emotional behavior and the conditions which generate it arc most 
easily examined when they are put to praetical use. Sometimes we 
wish to elicit the reflexes which commonly occur in emotion. Re¬ 
flexes, as we have seen, cannot be executed upon demand as “volun- 
tar)' behavior.” The poet who exclaims, “Oh, weep for Adonais!” 
does not actually expect the reader to respond in this way upon 
request. There is no interpersonal relationship which permits one 
person to evoke emotional behavior in another according to this 
formula. The only possibility is to use an eliciting stimulus, either 
conditioned or unconditioned. The “tear-jerker,” as we have noted, 
is a piece of writing which is designed literally to induce the secre¬ 
tion of tears. Other verbal repertoires are designed to evoke laughter. 
The use of conditioned stimuli to elicit emotional responses in this 
way is of great practical importance to professional entertainers. 

When we wish to eliminate responses of this sort, we adopt proce¬ 
dures appropriate to the conditioned reflex. When we control a 
companion’s tendency to laugh upon a solemn occasion by drawing 
his attention away from a funny event, we simply remove the stimu¬ 
lus for laughter. When we achieve the same effect by kicking him in 
the shins, we simply present the stimulus for an incompatible re¬ 
sponse. Practical use is also made of certain drugs which induce or 
eliminate emotional reactions. For example, in the military services 
a drug which reduces the responses characteristic of anxiety or fear 
is obviously of great value under battle conditions. 

Frequently it is also desirable to change emotional predispositions. 
In a “pep talk” a coach may take advantage of the fact that players 
exert themselves more aggressively against their opponents if they 
have been made angry. The skilled cross-examiner may use the same 
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procedure to lead a witness to emit verbal responses which would 
otherwise be withheld. Soldiers and civilian populations are aroused 
to aggressive action with stories of atrocities, reminders of present or 
past injuries, and so on. Since individual histories are involved, the 
effective operations are to be found, not in a theoretical analysis, but 
in a study of each case as it arises; a clear understanding of what is 
being done, however, may make such practices more effective. 

A particularly important emotional predisposition is that in which 
the individual favors a particular person, group, or state of affairs. It 
is hard to define the particular consequences of “favorable” behavior, 
but a fairly specific effect can often be discovered. A politician may 
arrange political rallies, kiss babies, publish favorable autobiographi¬ 
cal details, and so on, only to strengthen one very specific response 
on the part of the electorate—placing a mark on a ballot opposite his 
name. An author or playwright generates favorable responses toward 
his characters by depicting them in situations which strengthen such 
behavior or which counteract opposing, unfavorable behavior, and in 
this way he increases the chances that his book or play will be “liked”; 
but the behavior at issue may be nothing more than the purchase of 
books or tickets or the spreading of favorable reports. Part of the 
effect here is reinforcement, but we may also distinguish a kind of 
operation which must be classed as emotional. The advertiser inter¬ 
ested in generating “good will” for his product employs the same 
procedures, where the specific behavior at issue is the purchase of 
the product. 



CHAPTER XI 


AVERSION, AVOIDANCE, 
ANXIETY 


AVERSIVE BEHAVIOR 

The kind of stimuli which are usually called unpleasant, 
annoying, or, more technically, aversive are not distinguished by par¬ 
ticular physical specifications. Very strong stimuli are often aversive, 
but some weak stimuli are aversive also. Many aversive stimuli dam¬ 
age tissue or otherwise threaten the well-being of the individual, but 
this is not always true. Painful stimuli are generally aversive, but 
not necessarily so—as a counterirritant shows. Stimuli which have 
acquired their aversive power in the process of conditioning are 
especially unlikely to possess identifying physical properties. A stimu¬ 
lus is known to be aversive only if its removal is reinforcing. In 
Chapter V such a stimulus was called a negative reinforcer. We 
define both positive and negative reinforcers in terms of the strength¬ 
ening of a response. What happens when a positive reinforcer is 
withdrawn or a negative reinforcer presented will not be considered 
until the following chapter. 

Behavior which is followed by the withdrawal of an aversive stimu¬ 
lus is called escape. We weaken an aversive noise by putting fingers 
in our ears, by moving away from the source, by closing intervening 
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doors or windows, bv stopping it at the source, and so on. Similarly, 
we escape from a bright light by shutting our eyes, turning our head 
awav, or turning off the light. We cannot say that these responses 
arc positively reinforced with “freedom from” noise, light, and so on, 
since it is the change from one situation to another which is critical, 
and this is the reduction of a condition prevailing before reinforce¬ 
ment. 

In the laboratory' we condition a rat to press a lever by reducing 
the intensity of a light when it does so. The level of illumination is 
critical. A weak light may be ineffective and a ver)- strong light may 
lead to aversive behavior acquired earlier in the histor>' of the rat, 
such as shutting the eyes or covering the head with other parts of the 
body. A loud noise or a light shock delivered through the floor of the 
box is less likely to evoke previously established aversive behavior, 
but the use of such stimuli is complicated by other factors. Aversive 
stimuli elicit reflexes and generate emotional predispositions which 
often interfere with the operant to be strengthened. It is then diffi¬ 
cult to obser\'e the effect of negative reinforcement alone. 

Aversive stimuli are often used, both in the laboratory' and in the 
practical control of behavior, because of the immediacy of the result. 
When we present an aversive stimulus, any behavior which has pre¬ 
viously been conditioned by the withdrawal of the stimulus imme¬ 
diately follows, and the possibility of conditioning other behavior is 
immediately provided. The presentation of the aversive stimulus 
therefore resembles a sudden increase in deprivation (Chapter IX); 
but since deprivation and satiation differ in many respects from the 
presentation or removal of an aversive stimulus, it is advisable to 
consider the two kinds of operations separately. We study aversive 
behavior in accordance with our definition: by presenting an aversive 
stimulus, we create the possibility of reinforcing a response by with¬ 
drawing the stimulus. When conditioning has already taken place, 
the aversive stimulus provides an immediate mode of control. 

Hunger pangs are a possible source of confusion between depriva¬ 
tion and aversive stimulation. Since hunger is the commonest drive, 
we have tended to model our formulation of all drives upon it. But 
we have seen that pangs are not representative of drives in general 
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and that, even in the case of hunger, they call for a separate fomiu- 
lation. Insofar as one eats in order to reduce luinger pangs, tlie 
behavior is aversive. Whether pangs ever lead to eating before nega¬ 
tive reinforcement has taken place would be difficult to determine, 
since pangs arc produced by the vcr\- conditions which produce a 
heightened probability of eating regardless of the presence or absence 
of pangs. It is possible, however, to separate the producing of pangs 
from the increase in likelihood that eating will take place. W'hen 
stimulation which resembles a hunger pang arises from other sources 
—for example, an inflammation—aversive eating may take place with¬ 
out deprivation. On the other hand, when we drink water, chew an 
indigestible substance, or take certain drugs in order to reduce hunger 
pangs, we are emitting behavior which otherwise may not var\- with 
food deprivation. Similarly, although an individual may engage in 
certain sex practices because they reduce the time wasted in other 
sexual preoccupations, it does not follow that this result or the reduc¬ 
tion of any other aversive consequence is essential to the nomial 
variation in sexual behavior with deprivation or satiation. 

Just as we did not define a positive reinforcer as pleasant or satis¬ 
fying, so in defining a negative reinforcer in terms of its power to 
reinforce when withdrawn we do not assert that the stimulus is 
unpleasant or annoying. It would be as difficult to show that the 
reinforcing power of an aversive stimulus is due to its unpleasantness 
as to show that the reinforcing power of a positive reinforcer is due to 
its pleasantness. The arguments given in Chapter V on this point 
could be repeated step b)' step for the negati^'e case. There is also a 
parallel explanation in terms of biological significance. It is not diffi¬ 
cult to show that an organism which is reinforced by the withdrawal 
of certain conditions should have an advantage in natural selection. 

Conditioned aversive stimuli. The formula of stimulus substitu¬ 
tion applies to the function of negative reinforcement. Neutral events 
which accompany or precede established negative reinforcements 
become negatively reinforcing. Tims we move to escape from an 
annoying or oflFensive person even though he is not anno\’ing or 
offensive at the moment. The so-called cures for smoking and drink¬ 
ing mentioned in Chapter IV follow this formula. By pairing the taste 
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of tobacco or alcohol with a condition of nausea, the aversive behav¬ 
ior appropriate to nausea, perhaps including vomiting, is transferred 
to the tobacco or alcohol. 

HIE PRACTICAL USE OF AVERSIVE STIMULI 

We use negative reinforcement in several different ways. An aver¬ 
sive stimulus which has already been withdrawn to reinforce a desired 
operant offers, as we have seen, an immediate mode of control. One 
boy holds another on the ground until the victim cries “Uncle.” An 
arm is twisted until a gun is dropped. A horse is whipped until it 
moves at a given speed. We use conditioned aversive stimuli in the 
same way—when, for example, we “shame” someone into acting. 
The boy who does not dive from the high board is called a sissy; and 
he can escape from this conditioned verbal stimulus only by diving. 
His companions present the stimulus to increase the probability that 
he will dive. “Daring” is a similar practice. (The inverse case, as we 
shall see in the next chapter, is to prevent behavior from occurring 
by branding it shameful. Shameful behavior is behavior which one 
may be “shamed out of.” Escape from the aversive shame is achieved 
bv not engaging in the behavior or, more obviously, by engaging in 
conspicuously incompatible behavior.) 

We extend the effectiveness of the technique when we condition 
behavior so that future aversive stimuli will have an effect. We may 
plan to present these stimuli upon later occasions, or we may simply 
prepare for them whenever they may occur. Conditioning is an 
important stage in the exploiting of aversive control in ethics, reli¬ 
gion, and government, as we shall see in Section V. 

We also condition aversive stimuli in order to provide for nega¬ 
tive reinforcement. A neutral stimulus which is likely to occur on 
some later occasion is made aversive by being paired with aversive 
stimuli. Escape is then automatically reinforced. For example, the 
spread of venereal disease is to some extent controlled by educa¬ 
tional programs which provide for the future reinforcement of aver- 
si%’e behavior to prostitutes or “easy pickups.” Descriptions or pic¬ 
tures of such people are paired with aversive information about 
venereal disease. One result is a strong emotional response at the 
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sight of a prostitute which may be effective from the point of view 
of the educational program by being incompatible with sexual beha¬ 
vior: the individual may be too frightened to participate. To this 
extent the effect is emotional rather than aversive. Another object 
of such a program, however, is to guarantee the reinforcement of 
aversive behavior. When the individual looks away, turns away, or 
walks away from the prostitute, his behavior will be reinforced by 
the reduction of a conditioned aversive stimulus. 

An important example of this use of aversive conditioning is the 
practice of branding an act wrong or sinful. Any behavior which 
reduces the stimulation arising from the early stages of such an act 
is then negatively reinforced. A single pairing of two stimuli may be 
sufficient to transfer aversive power, and a conditioned reinforcer 
may continue to be effective long after the basic unconditioned rcin- 
forcers have disappeared from the environment. Many problems in 
psychotherapy arise from the strength and duration of this effect, 
as we shall see in Chapter XXIV. 

The withdrawal of a positive reinforcer has by definition the same 
effect as the presentation of a negative. Taking away privileges is not 
veiy' different from establishing aversive conditions. We occasionally 
remove a positive reinforcer for practical purposes. What is removed 
is, more precisely, a conditioned positive reinforcer—a discriminative 
stimulus or, in other words, the occasion for successful action. There 
are several subtle distinctions here which are perhaps more important 
for the theory of behavior than for its practical control. Suppose we 
have deprived a man of permission to leave a military camp until a 
certain task has been performed, and suppose that upon past occa¬ 
sions the performance of similar tasks has been followed by the restor¬ 
ation of this privilege. Have we generated a state of deprivation, in 
which behavior which has been reinforced by the return of privileges 
will be strong, or have we presented an aversive condition from which 
the individual can escape only by performing the required task? It is 
possible, of course, that we have done both. Practically, the distinc¬ 
tion may appear to be of little importance, but certain collateral 
results depend upon the extent to which each is involved. 
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AN'OIDANCE 

Escaping from an aversive condition is clearly not the same as 
avoiding it, since the aversive condition which is avoided does not 
directly affect the organism. Although avoidance suggests that behav¬ 
ior may be influenced by an event which does not occur, we may 
account for the effect without violating any fundamental principle 
of science with the concept of conditioned negative reinforcement. 
In avoidance the conditioned and unconditioned aversive stimuli are 
separated by an appreciable inter\'al of time. Tire required temporal 
relation is commonly encountered in nature. A rapidly approaching 
object precedes painful contact. The sputter of the fuse precedes the 
explosion of the firecracker. The sound of the dentist’s drill precedes 
painful stimulation in the tooth. The internal separating the two 
stimuli may be definitely fixed, or it may var\^ widely. In any case, the 
individual comes to execute behavior which prevents the occurrence 
or reduces the magnitude of the second stimulus. He dodges the 
object, puts his fingers in his ears to soften the sound of the explo¬ 
sion. and jerks his head away from the drill. Why? 

When stimuli occur in this order, the first stimulus becomes a 
conditioned negative reinforcer, and henceforth any action which 
reduces it is strengthened through operant conditioning. When we 
avoid the painful stimulation of the tooth, we merely escape from 
the sound of the drill. That the behavior of avoidance appears to be 
“directed” toward a future event may be explained as in operant 
behavior in general: it is always past occurrences of conditioned nega¬ 
tive rcinforcers and past instances of their reduction which are respon¬ 
sible for the probability of the escape response. The fact that the 
future event does not occur when the behavior is emitted would 
raise a puzzling issue if the behavior did in fact continue in strength. 
But if an occasion for avoidance behavior arises often enough, the 
conditioned aversive situation grows progressively weaker. The behav¬ 
ior is no longer reinforced, and eventually not emitted. When this 
happens, the primary negative reinforcer is received. A single instance 
may suffice to recondition the reinforcing power of the earlier stimu¬ 
lus. Thus when certain visual stimuli generated by a rapidly approach- 
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ing object are followed bv injim’, anv behavior which converts the 
stimuli into more harmless forms will be strengthened. Moving out 
of the way, dodging, and putting up a guard are cases in point. By 
virtue of these responses the individual is successful in avoiding 
injuiy', but he is reinforced only in escaping from the conditioned 
aversive stimuli which we call the “threat” of injury. If injur)' is 
always avoided, the threat grows weaker, and the behavior is less and 
less strongly reinforced. Eventually a response is not made, an injury 
is received, and the visual pattern is re-established as a negative rein- 
forcer. Similarly, if the stimulation incidental to the eating of a 
particular food always precedes a severe allergic headache, it may 
become aversive. As a result the food is not eaten, the headaches do 
not occur, and the original conditioning of the negative reinforcer 
suffers extinction. Eventually the food is no longer aversive. When 
it is eaten again, another headache occurs, the conditioned nega¬ 
tive reinforcer is again established, and another cycle is begun. 
TTie “absence of a headache” has had an effect upon behavior 
only in furthering the extinction of the conditioned aversive stim¬ 
ulus. 

The practical use of a “threat” is familiar to eveiy'one. The bandit 
threatens his victim by creating a condition which has preceded 
physical injur)', and the victim reduces this threat by turning over 
his pocketbook. Escape—running away—may also be highly probable, 
but it is only the behavior with respect to the pocketbook which fits 
the present formula. A threat is something more than daring or sham¬ 
ing because of the special temporal relation between conditioned and 
unconditioned negative reinforcers. Nothing else happens if a dare is 
not taken; the aversive condition simply continues. 

Any stimulus which consistently precedes the aversive withdrawal 
of a positive reinforcer may come to act as a conditioned negative 
reinforcer. We avoid an aversive condition when we act to reduce 
any indication that an entertaining program will be brought to an 
end or that any advantage in a competitive affair will be reduced or 
that we shall lose the affection or love or services of someone who is 
important to us. The behavior reinforced by reducing such threats 
will not necessarily be the same as that which is positively reinforced 
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by the entertaining prograni, by the advantage, or by love, affection, 
or services. 

ANXIETY 

A stimulus which characteristically precedes a strong negative rein- 
forcer has a far-reaching effect. It evokes behavior which has been 
conditioned by the reduction of similar threats and also elicits strong 
emotional responses. The bandit’s victim not only turns over his 
pocketbook and displays a high probability of running away, he also 
undergoes a violent emotional reaction which is characteristic of all 
stimuli leading to avoidance behavior. One who has been severely 
seasick will tend to escape from conditioned aversive stimuli which 
occur while planning a trip, while going up the gang-plank, and so 
on—for example, he will tend to cancel his trip or turn and rush off 
the ship. He will also exhibit strong conditioned reflexes transferred 
from the original stimulation of the ship in motion. Some of these 
may be simple gastric responses which we should not call emotional. 
Others may be of the sort commonly seen in fear. Operant behavior 
will be also markedly changed. The individual may seem “preoccu¬ 
pied”—which may mean nothing more than that he is not normally 
occupied. He may find it impossible to engage in normal conversa¬ 
tion or to attend to the simplest practical affairs. He may speak curtly 
and show none of his usual interests. These are emotional effects 
upon probability which might have been considered in Chapter X. 
They can occur, however, only when a stimulus characteristically 
precedes an aversive stimulus by an interval of time sufficiently great 
to permit behavioral changes to be observed. The condition which 
results is usually called anxiety. 

Almost every strong aversive stimulus is preceded by a characteris¬ 
tic stimulus which may come to generate anxiety. Contingencies of 
this sort are arranged in the practical control of behavior, often in 
connection with punishment. Although the biological advantage of 
avoidance is obvious, the emotional pattern of anxiety appears to 
serve no useful purpose. It interferes with the normal behavior of the 
individual and may even disorganize avoidance behavior which would 
otherwise be effective in dealing with the circumstances. For this 
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reason anxiety is an important problem in psychotherapy, as we shall 
see in Chapter XXI\^. In the design of controlling techniques the pos¬ 
sibility of generating anxietv as an unfortunate bv-product must con¬ 
stantly be kept in mind. 

Since conditioning may take place as the result of one pairing of 
stimuli, a single aversive event may bring a condition of anxiety under 
the control of incidental stimuli. The sudden death of a close friend, 
for example, is sometimes followed by a sustained depression which 
may be verbalized as a feeling that “something is going to happen,” 
as a “feeling of doom,” and so on. It is hard to deal with such a case. 
When we say that a death was sudden or occurred without warning, 
we mean that no prior stimulus was partieularly associated with it. 
The stimuli which received the force of the conditioning were there¬ 
fore the undistinguished elements of daily life. It is not likely that 
there arc any successful forms of escape appropriate to these stimuli, 
although other forms of escape may, through induction, be strength¬ 
ened. Conditioned emotional reflexes, as well as conditioned emo¬ 
tional predispositions, may be almost constantly activated. In the 
case of an “expected” death—for example, the death of someone who 
has been ill for a long time—the event may be equally aversive, but 
the anxiety is conditioned to the specific stimuli which precede it. 
Anxiety is not so likely to arise again unless these stimuli are rein¬ 
stated—for example, through the illness of another friend. 

Although the emotional aspect of anxiety may be distinguished 
from the conditioned aversive effect responsible for avoidance behav¬ 
ior, it is possible that the emotion is also aversive. Avoidance re¬ 
sponses may be interpreted as in part an escape from the emotional 
components of anxiety. Thus we avoid the dentist’s office, not only 
because it precedes painful stimulation and is therefore a negative 
reinforccr, but because, having preceded such stimulation, it arouses 
a complex emotional condition which is also aversive. The total 
effect may be extremely powerful. A problem of great militaiy' impor¬ 
tance is the behavior of avoiding battle. Malingering, desertion, or a 
“nen'ous breakdown” may reach a veiy' high probability. Successful 
preparation of the fighting man requires a clear understanding of the 
effect of the stimuli which precede the more aversive stimuli of com- 
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bat. Ttie man may be avoiding, not merely battle, but his own 
reactions of anxiety. 

ANXIETY AND ANTICIPATION 

A counterpart of anxiety arises when a stimulus precedes a positive 
reinforcement by an appreciable inter\'al. If an envelope received 
through the mail contains bad news, a similar envelope received later 
will, before it is opened, generate the anxiety just described. But 
envelopes also contain good news—perhaps a check or the offer of a 
good job. Here the avoidance behavior strengthened by bad news- 
turning away from the mail box, throwing the envelope down un¬ 
opened, losing the envelope before it is opened, and so on—has its 
parallel in the increased probability of looking in the box, opening 
the letter in haste, and so on. Emotional reflexes in response to the 
unopened envelope will be appropriate to bad news in the one case 
and to good news in the other. Instead of responses commonly 
obser\'cd in grief, sorrow, or fear, we may observe responses character¬ 
istic of elation or joy. Emotional predispositions also stand in the 
same polar opposition: the general depression of activity in the one 
case is matched by a general heightening of activity in the other. 
Instead of growing silent and reseiA'ed, our subjeet speaks to every¬ 
one, reacts in an exaggerated fashion, walks faster and seemingly 
more lightly, and so on. This is particularly obvious in the behavior 
of young children—for example, on the eve of a holiday or festival. 

The effect of stimuli which characteristically precede positive rein¬ 
forcement may be chronic in a world in which “good"’ things fre¬ 
quently happen. It is not seen in the clinic because it is not trouble¬ 
some. Anxiety, which is chronic in a world in which “bad” things 
frequently happen, has resulting disadvantages both to the individual 
and to society. 

ANXIETY NOT A CAUSE 

Anxiety, as a special case of emotion, should be interpreted with 
the usual caution. When we speak of the effects of anxietyy we imply 
that the state itself is a cause, but so far as we are concerned here, 
the term merely classifies behavior. It indicates a set of emotional 
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predispositions attributed to a special kind of circumstance. Any 
therapeutic attempt to reduce the “effects of anxiety” must operate 
upon these circumstances, not upon any intervening state. 'I’hc middle 
term is of no functional significance, either in a theoretical analysis 
or in the practical control of behavior. 



CHAPTER XII 


PUNISHMENT 


A QUESTIONABLE TECHNIQUE 

Tlie commonest technique of control in modem life is 
punishment. The pattern is familiar: if a man does not behave as 
you wish, knock him down; if a child misbehaves, spank him; if the 
people of a country misbehave, bomb them. Legal and police systems 
are based upon such punishments as fines, flogging, incarceration, 
and hard labor. Religious control is exerted through penances, threats 
of excommunication, and consignment to hell-fire. Education has not 
wholly abandoned the birch rod. In everyday personal contact we 
control through censure, snubbing, disapproval, or banishment. In 
short, the degree to which we use punishment as a technique of 
control seems to be limited only by the degree to which we can gain 
the necessary power. All of this is done with the intention of reduc¬ 
ing tendencies to behave in certain ways. Reinforcement builds up 
these tendencies; punishment is designed to tear them down. 

The technique has often been analyzed, and many familiar ques¬ 
tions continue to be asked. Must punishment be closely contingent 
upon the behavior punished? Must the individual know what he is 
being punished for? What forms of punishment are most effective 
and under what circumstances? This concern may be due to the reali- 
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zation that the technique has unfortunate by-products. In the long 
run, punishment, unlike reinforcement, works to the disadvantage 
of both the punished organism and the punishing agency. The aver¬ 
sive stimuli which arc needed generate emotions, including predis¬ 
positions to escape or retaliate, and disabling anxieties. For thou¬ 
sands of years men have asked whether the method could not be 
improved or whether some alternative practice would not be better. 

DOES PUNISHMENT WORK? 

More recently, the suspicion has also arisen that punishment does 
not in fact do what it is supposed to do. An immediate effect in 
reducing a tendency to behave is clear enough, but this may be mis¬ 
leading. The reduction in strength may not be permanent. An ex¬ 
plicit revision in the theoiy' of punishment may be dated by the 
changes in the theories of E. L. Thorndike. Thorndike’s first formu¬ 
lation of the behavior of his cats in a puzzle box appealed to two 
processes: the stamping in of rewarded behavior, or operant condi¬ 
tioning, and a converse process of stamping out as the effect of pun¬ 
ishment. Tliorndikc’s later experiments with human subjects required 
a change in this formulation. The rewards and punishments he used 
were the relatively mild, verbal conditioned reinfoicers of “right” 
and “wrong.” Thorndike found that although “right” strengthened 
the behavior that preceded it, “wrong” did not weaken it. The rela¬ 
tively trivial nature of the punishment was probably an advantage, 
since the collateral effects of severe punishment could be avoided 
and the absence of a weakening effect could therefore be obser\'ed 
without interference from other processes. 

The difference between immediate and long-term effects of pun¬ 
ishment is clearly shown in animal experiments. In the process of 
extinction the organism emits a certain number of responses which 
can be reasonably well predicted. As we have seen, the rate is at first 
high and then falls off until no significant responding occurs. The 
cumulative extinction cuiA^e is one way of representing the net effect 
of reinforcement, an effect which we may describe as a predisposition 
to emit a certain number of responses without further reinforce¬ 
ment. If we now punish the first few responses emitted in extinction, 
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the tlieor)' of punishment would lead us to expect that the rest of 
the extinction curve would contain fewer responses. If we could 
choose a punishment which subtracted the same number of responses 
as are added by a reinforcement, then fifty reinforced responses fol¬ 
lowed by twenty-five punished responses should leave an extinction 
curve characteristic of twenty-five reinforced responses. When a simi¬ 
lar experiment was performed, however, it was found that although 
punishing responses at the beginning of an extinction curve reduced 
the momentary rate of responding, the rate rose again when punish¬ 
ment was discontinued and that eventually all responses came out. 
The effect of punishment was a temporary suppression of the behav¬ 
ior, not a reduction in the total number of responses. Even under 
severe and prolonged punishment, the rate of responding will rise 
when punishment has been discontinued, and although under these 
circumstances it is not easy to show that all the responses originally 
available will eventually appear, it has been found that after a given 
time the rate of responding is no lower than if no punishment had 
taken place. 

The fact that punishment does not permanently reduce a tend¬ 
ency to respond is in agreement with Freud’s discovery of the sur¬ 
viving activity of what he called repressed wishes. As we shall see 
later, Freud’s observations can be brought into line with the present 
analysis. 

THE EFFECTS OF PUNISHMENT 

If punishment is not the opposite of reward, if it does not work by 
subtracting responses where reinforcement adds them, what does it 
do? We can answer this question with the help of our analysis of 
escape and of avoidance and anxiety. The answer supplies not only 
a clear-cut picture of the effect of punishment but an explanation of 
its unfortunate by-products. The analysis is somewhat detailed, but 
it is essential to the proper use of the technique and to the therapy 
required to correct some of its consequences. 

We must first define punishment without presupposing any effect. 
Tliis may appear to be difficult. In defining a reinforcing stimulus 
we could avoid specifying physical characteristics by appealing to the 
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effect upon the strength of the behavior. If a punishing consequence 
is also defined without reference to its physical characteristics and 
if there is no comparable effect to use as a touchstone, wliat course 
is open to us? The answer is as follows. We first define a positive 
reinforcer as any stimulus the presentation of which strengtlicns the 
behavior upon which it is made contingent. We define a negative 
reinforccr (an aversive stimulus) as any stimulus the u'itfidrawal of 
which strengthens behavior. Both are reinforcers in the literal sense 
of reinforcing or strengthening a response. Insofar as scientific defi¬ 
nition corresponds to lay usage, they are both "rewards.” In solving 
the problem of punishment we simply ask: WMiat is the effect of 
withdrawing a positive reinforcer or presenting a negative? An ex¬ 
ample of the former would be taking candy from a babv; an example 
of the latter, spanking a baby. We have not used any new terms in 
posing these questions and hence need not define any. Yet insofar 
as we are able to give a scientific definition of a lav term, these two 
possibilities appear to constitute the field of punishment. We do 
not presuppose any effect; we simply raise a question to be answered 
by appropriate experiments. Tlie physical specifications of both kinds 
of consequences are determined in the case in which behavior is 
strengthened. Conditioned reinforcers, including the generalized 
reinforcers, fit the same definition: we punish by disapproving, by 
taking money away, as in a legal fine, and so on. 

Although punishment is a powerful technique of social control, it 
is not necessarily administered by another individual. The burned 
child has been punished for touching flame. Eating unsuitable food 
is punished by indigestion. It is not necessary' that the contingency 
represent an established functional relation, such as that between 
flames and bums or certain foods and indigestion. When a salesman 
in a midwestern city once approached a house and rang the door¬ 
bell, the rear of the house exploded. There was only an accidental 
and very rare contingency: gas had escaped into the kitchen, and the 
explosion was set off by sparks from the electric doorbell. The effect 
upon the subsequent behavior of the salesman as he rang other door¬ 
bells nevertheless falls within the present field. 
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A FIRST EFFECT OF PUNISHMENT 

The first effect of the aversive stimuli used in punishment is con¬ 
fined to the immediate situation. It need not be followed by any 
change in behavior upon later occasions. When we stop a child from 
giggling in church by pinching it severely, the pinch elicits responses 
which are incompatible with laughing and powerful enough to sup¬ 
press it. Although our action may have othef consequences, we can 
single out the competing effect of the responses elicited by the pun¬ 
ishing stimulus. The same effect is obtained with a conditioned stim¬ 
ulus when we stop the child with a threatening gesture. This requires 
earlier conditioning, but the current effect is simply the elicitation 
of incompatible behavior—the responses appropriate, for example, to 
fear. The formula can be extended to include emotional predispo¬ 
sitions. Thus we may stop a man from running away by making him 
angry. The aversive stimulus which makes him angry may be uncon¬ 
ditioned (for example, stamping on his toe) or conditioned (for 
example, calling him a coward). We may stop someone from eating 
his dinner by frightening him with a sudden deafening noise or a 
gruesome story. 

It is not essential to this effect that the aversive stimulus be con¬ 
tingent upon behavior in the standard punishing sequence. When 
that sequence is observ^ed, however, the effect still occurs and must 
be considered as one of the results of punishment. It resembles other 
effects of punishment in bringing undesirable behavior to an end; 
but since this is temporar)% it is not likely to be accepted as typical 
of control through punishment. 

A SECOND EFFECT OF PUNISHMENT 

Punishment is generally supposed to have some abiding effeet. It 
is hoped that some change in behavior will be observed in the future, 
even though further punishment is withheld. One enduring effect, 
also not often considered as typical, resembles the effect just con¬ 
sidered. When a child who has been pinched for giggling starts to 
giggle upon a later occasion, his own behavior may supply condi¬ 
tioned stimuli which, like the mother's threatening gesture, evoke 
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opposed emotional responses. We have seen an adult parallel in the 
use of drugs which induce nausea or other aversive conditions as 
consequences of drinking alcoholic beverages. As a result later drink¬ 
ing generates conditioned aversive stimuli whicli evoke responses 
incompatible with further drinking. As an effect of the severe pun¬ 
ishment of sexual behavior, the early stages of such behavior generate 
conditioned stimuli giving rise to emotional responses which interfere 
with the eompletion of the behavior. One difficulty with the tech¬ 
nique is that punishment for sexual beliavior may interfere with simi¬ 
lar behavior under socially acceptable eircumstances—for example, in 
marriage. In general, then, as a second effect of punisliment, behavior 
which has consistently been punished becomes the source of condi¬ 
tioned stimuli which evoke incompatible behavior. 

Some of this behavior involves glands and smooth muscles. Let us 
say, for example, that a child is consistently punished for lying. The 
behavior is not easily specified, since a verbal response is not necessar¬ 
ily in itself a lie but can be defined as such only by taking into account 
the circumstances under which it is emitted. These circumstances 
come to play a conspicuous role, however, so that the total situation 
stimulates the child in a characteristic fashion. For reasons which we 
shall examine in Chapter XVII, an individual is in general able to tell 
when he is lying. The stimuli to which he responds when he docs so 
are conditioned to elicit responses appropriate to punishment: his 
palms may sweat, his pulse may speed up, and so on. When he later 
lies during a lie-detection test, these conditioned responses are 
recorded. 

Strong emotional predispositions are also rearoused by the begin¬ 
nings of severely punished behavior. Tliese are the main ingredient 
of what we speak of as guilt, shame, or a sense of sin. Part of what 
we feel when we feel guilty are conditioned responses of glands and 
smooth muscles of the kind reported by the lie detector, but we may 
also recognize a displacement of the normal probabilities of our 
behavior. TTiis is often the most conspicuous feature of the guilt of 
others. The furtive look, the skulking manner, the guilty way of 
speaking are emotional effects of the conditioned stimuli aroused by 
punished behavior. Comparable effects are obserx'cd in lower animals: 
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the guilty behavior of a dog which is behaving in a way which has 
previously been punished is a familiar spectacle. A case may be easily 
set up in the laboraton,'. If a rat has been conditioned to press a lever 
by being reinforced with food and is then punished by being lightly 
shocked as it presses the lever, its behavior in approaching and touch¬ 
ing tlie lever will be modified. The early stages in the sequence gener¬ 
ate conditioned emotional stimuli which alter the behavior previously 
established. Since the punishment is not directly administered by 
another organism, the pattern does not resemble the more familiar 
behavior of guilt in the pet dog. 

A condition of guilt or shame is generated not only by previously 
punished behavior but by any consistent external occasion for such 
behavior. Tlie individual may feel guilty in a situation in which he 
has been punished. We gain control by introducing stimuli for just 
this effect. For example, if we punish a child for any behavior exe¬ 
cuted after we have said “No, no!” this verbal stimulus will later 
evoke an emotional state appropriate to punishment. When this 
policy has been followed consistently, the behavior of the child may 
be controlled simply by saying “No, no!” since the stimulus arouses 
an emotional condition which conflicts with the response to be con¬ 
trolled. 

Although the rearousal of responses appropriate to aversive stimuli 
is again not the main effect of punishment, it works in the same 
direction. In none of these cases, however, have we supposed that the 
punished response is permanently weakened. It is merely temporarily 
suppressed, more or less effectively, by an emotional reaction. 

A THIRD EFFECT OF PUNISHMENT 

We come now to a much more important effect. If a given response 
is followed by an aversive stimulus, any stimulation which accom¬ 
panies the response, whether it arises from the behavior itself or from 
concurrent circumstances, will be conditioned. We have just appealed 
to this formula in accounting for conditioned emotional reflexes and 
predispositions, but the same process also leads to the conditioning 
of aversive stimuli which serve as negative reinforcers. Any behavior 
which reduces this conditioned aversive stimulation will be reinforced. 
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In tlie example just considered, as the rat approaches the le\cr to 
which its recent responses have been punished, powerful conditioned 
aversive stimuli are generated by the increasing proximitv of the lever 
and by the rat's own behavior of approach. Anv behavior which 
reduces these stimuli—turning or running awav, for example—is 
reinforced. Technically we may say that further punishment is 
avoided. 

The most important effect of punishment, then, is to establish 
aversive conditions which are avoided bv any behavior of “doing 
something else.” It is important—for both practical and theoretical 
reasons—to specify this behavior. It is not enough to say that what is 
strengthened is simply the opposite. Sometimes it is merely “doing 
nothing” in the fonn of actively holding still. Sometimes it is behav¬ 
ior appropriate to other current variables which are not. however, 
sufficient to explain the level of probability of the behavior without 
supposing that the individual is also acting “for the sake of keeping 
out of trouble.” 

The effect of punishment in setting up behavior which competes 
with, and may displace, the punished response is most commonly 
described by saying that the individual represses the behavior, but 
we need not appeal to any activity which does not have the dimen¬ 
sions of behavior. If there is any repressing force or agent, it is simply 
the incompatible response. The individual contributes to the process 
by executing this response. (In Chapter X^^III we shall find that an¬ 
other sort of repression involves the individual’s knowledge of the 
repressed act.) No change in the strength of the punished response 
is implied. 

If punishment is repeatedly avoided, the conditioned negative 
reinforcer undergoes extinction. Incompatible behavior is then less 
and less strongly reinforced, and the punished behavior eventually 
emerges.* When punishment again occurs, the aversive stimuli are 
reconditioned, and the behavior of doing something else is then 
reinforced. If punishment is discontinued, the behavior may emerge 
in full strength. 

When an individual is punished for not responding in a given way, 
conditioned aversive stimulation is generated when he is doing any- 
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thing else. Only by behaving in a given way may he become free of 
“guilt.” Thus one may avoid the aversive stimulation generated by 
“not doing one’s duty” by simply doing one’s duty. No moral or 
ethical problem is necessarily involved: a draft horse is kept moving 
according to the same formula. When the horse slows down, the 
slower pace (or the crack of a whip) supplies a conditioned aversive 
stimulus from which the horse escapes by increasing its speed. The 
aversive effect must be reinstated from time to time by actual contact 
with the whip. 

Since punishment depends in large part upon the behavior of other 

4 

people, it is likely to be intermittent. The action which is always 
punished is rare. All the schedules of reinforcement described in 
Chapter VI are presumably available. 

SOME UNFORTUNATE BY-PRODUCTS 
OF PUNISHMENT 

Severe punishment unquestionably has an immediate effect in 
reducing a tendency to act in a given way. This result is no doubt 
responsible for its widespread use. We “instinctively” attack anyone 
whose behavior displeases us—perhaps not in physical assault, but 
with criticism, disapproval, blame, or ridicule. Whether or not there 
is an inherited tendency to do this, the immediate effect of the prac¬ 
tice is reinforcing enough to explain its currency. In the long run, 
however, punishment does not actually eliminate behavior from a 
repertoire, and its temporary achievement is obtained at tremendous 
cost in reducing the over-all efficiency and happiness of the group. 

One by-product is a sort of conflict between the response which 
leads to punishment and the response which avoids it. These re¬ 
sponses are incompatible and they are both likely to be strong at the 
same time. Tire repressing behavior generated by even severe and 
sustained punishment often has very little advantage over the behav¬ 
ior it represses. The result of such a conflict is discussed in Chapter 
XIV. When punishment is only intermittently administered, the con¬ 
flict is especially troublesome, as we see in the case of the child who 
“does not know when he will be punished and when he will get away 
with it.” Responses which avoid punishment may alternate with 
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punished responses in rapid oscillation or both may blend into an 
uncoordinated form. In the awkward, timorous, or “inhibited” per¬ 
son, standard behavior is interrupted by distracting responses, such 
as turning, stopping, and doing something else. 'I hc stutterer or 
stammerer shows a similar effect on a finer scale. 

Another by-product of the use of punishment is even more unfor¬ 
tunate. Punislied behavior is often strong, and certain incipient stages 
are therefore frequently reached. Even though the stimulation thus 
generated is successful in preventing a full-scale occurrence, it also 
evokes reflexes characteristic of fear, anxiety, and other emotions. 
Moreover, the incompatible behavior which blocks the punished 
response may resemble external physical restraint in generating rage 
or frustration. Since the variables responsible for these emotional 
patterns are generated by the organism itself, no appropriate escape 
behavior is available. The condition may be chronic and may result 
in “psychosomatic” illness or otherwise interfere with the effective 
behavior of the individual in his daily life (Chapter XXIV). 

Perhaps the most troublesome result is obtained when the behavior 
punished is reflex—for example, weeping. Mere it is usually not pos¬ 
sible to execute “just the opposite,” since such behavior is not con¬ 
ditioned according to the operant formula. The repressing behavior 
must therefore work through a second stage, as in the operant control 
of “involuntary behavior” discussed in Chapter VI. Some examples 
will be considered in Chapter XXIV where the techniques of psycho¬ 
therapy will be shown to be mainly concerned with the unfortunate 
by-products of punishment. 

ALTERNATIVES TO PUNISHMENT 

We may avoid the use of punishment by weakening an operant in 
other ways. Behavior which is conspicuously due to emotional cir¬ 
cumstances, for example, is often likely to be punished, but it may 
often be more effectively controlled by modifying the circumstances. 
Changes brought about by satiation, too, often have the effect which 
is contemplated in the use of punishment. Behavior may often be 
eliminated from a repertoire, especially in young children, simply by 
allowing time to pass in accordance with a developmental schedule. 
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If the behavior is largely a function of age, the child will, as we say, 
outgrow it. It is not always easy to put up with the behavior until 
this happens, especially under the conditions of the average house¬ 
hold, but there is some consolation if we know that by carrying the 
child through a socially unacceptable stage we spare him the later 
complications arising from punishment. 

Another way of weakening a conditioned response is simply to let 
time pass. Tliis process of forgetting is not to be confused with 
extinction. Unfortunately it is generally slow and also requires that 
occasions for the behavior be avoided. 

The most effective alternative process is probably extinction. This 
takes time but is much more rapid than allowing the response to be 
forgotten. The technique seems to be relatively free of objectionable 
by products. We recommend it, for example, when we suggest that 
a parent “pay no attention” to objectionable behavior on the part of 
his child. If the child’s behavior is strong only because it has been 
reinforced by “getting a rise out of” the parent, it will disappear when 
this consequence is no longer forthcoming. 

Another technique is to condition incompatible behavior, not by 
withdrawing censure or guilt, but through positive reinforcement. 
We use this method when we control a tendency toward emotional 
display by reinforcing stoical behavior. This is very different from 
punishing emotional behavior, even though the latter also provides 
for the indirect reinforcement of stoical behavior through a reduction 
in aversive stimuli. Direct positive reinforcement is to be preferred 
because it appears to have fewer objectionable by-products. 

Civilized man has made some progress in turning from punish¬ 
ment to alternative forms of control. Avenging gods and hell-fire have 
given way to an emphasis upon heaven and the positive consequences 
of the good life. In agriculture and industry, fair wages are recognized 
as an improvement over slavery. The birch rod has made way for the 
reinforcements naturally accorded the edueated man. Even in politics 
and government the power to punish has been supplemented by a 
more positive support of the behavior which conforms to the inter¬ 
ests of the governing agency. But we are still a long way from exploit¬ 
ing the alternatives, and we are not likely to make any real advance 



PUNISHMENT 193 


SO long as our information about punishment and the alternatives to 
punishment remains at tlie level of casual obscr\ation. As a consist¬ 
ent picture of the extremclv complex consequences of punishment 
emerges from analvtical research, we may gain the confidence and 
skill needed to design alternative procedures in the clinic, in educa¬ 
tion, in industr)’, in politics, and in other praetieal fields. 



CHAPTER XIII 


FUNCTION VERSUS ASPECT 


Frequently we describe behavior not with verbs which spec¬ 
ify action but with adjectives describing characteristics or aspects of 
action. Instead of saying, “He shook hands and said, ‘Hello, hello,'" 
we may say, “He was most cordial." The adjective “cordial" is one of 
a list of about 4,500 English words compiled by Allport and Odbert 
which refer to more or less enduring traits of human behavior. If we 
add terms which refer to temporary conditions, such as “embarrassed" 
or “hazy," the number is about doubled. Most of these trait-names 
are nontechnical words which we use in our daily affairs. They are an 
essential tool of the novelist; literature is, in fact, responsible for add¬ 
ing many of them to the language. By describing human behavior in 
characteristic situations, the storyteller creates convenient expressions 
for later use—such as “dog in the manger" or “a Daniel come to 
judgment." The list has also been extended by the invention of such 
technical terms as “phlegmatic" and “melancholic" or, more recently, 
“inhibited,” “introverted,” and “cerebrotonic." 

Staying at a single letter in the Allport and Odbert list, a biogra¬ 
pher might describe the behavior of a subject as follows: “There was 
a remarkable change in his behavior. Where he had been happy-go- 
lucky, he grew hesitant and heavy-handed. His natural humility gave 
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way to a sustained haughtiness. Once the most helpful of men, he 
became heedless and hard-hearted. A sort of histrionic horseplay was 
all that remained of his fine sense of hinnor." A passage of this sort 
tells us something important. If it were a description of an old friend, 
for example, it would prepare us to deal with him more effectively 
when we saw him again. Rut it may come as something of a surprise 
to discover that no behavior has actually been described. Not a single 
action has been mentioned. The passage might be describing a scries 
of letters—of a colleague or business acquaintance, perhaps. On the 
other hand, it might be describing a wholly nonverbal scene from a 
ballet. It might concern a shopkeeper, a plant foreman, a salesman, 
a diplomat, a schoolboy—in short, any one of dozens of different 
kinds of people whose behavior would have nothing in common 
except those aspects to which the passage refers. 

llicre arc practical circumstances under which it is useful to know 
that a man will bcha\'e in a gi\cn manner even though we may not 
know precisely what he will do. To be able to predict, for example, 
that a proposal will probably be “received favorably” is valuable even 
though the specific form of the reception remains to be seen. Under 
certain circumstances everything else about the behavior may be 
irrelevant, and a description in terms of traits is then highly eco¬ 
nomical. Rut are terms of this sort valuable in a functional analysis? 
And if they are, how are they related to the variables which we have 

so far considered? 

WHAT ARE TRAITS? 

A common and unchanging property of the behavior of all mem¬ 
bers of a species would not usefully be referred to as a trait at all. 
It is only because people differ from moment to moment or from 
person to person that trait-names arise. We may look for the equi\a- 
Icnts of traits in a functional analysis, therefore, by asking in how 
many ways we should expect a person to differ from other persons 

or from himself from time to time. 

Differences in variables. Some differences are due to the differences 
in the independent variables to which people are exposed. Although 
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we mav be struck by the effect upon behavior, the original individu¬ 
ality lies outside the organism. Differences in experience between the 
“ignorant” and the ‘‘learned,” the “naive” and the “sophisticated,” or 
the “innocent” and the “worldly” refer mainly to differences in his¬ 
tories of reinforcement. Such terms as “enthusiastic,” “interested,” 
and “discouraged” describe the effects of different schedules of rein¬ 
forcement. People are “inhibited,” “timid,” or “cowed” because of 
special contingencies involving punishment. The “discriminating” 
individual has made distinctions among stimuli which are not made 
by the undiscriminating. Differences in deprivation lead us to dis¬ 
tinguish between the “voracious” and the “finicky,” the “libidinous” 
and the “sexless.” Differences in hereditary endowment, which are 
too conspicuous to be overlooked when we compare different species 
but presumably are also present to a lesser extent between members 
of a single species, account for other differences in repertoire, as do 
differences in age (“youthful,” “senile”) or in development (“infan¬ 
tile,” “adolescent”). The field of emotion has scarcely advanced 
beyond an aspect-description, where more or less transitory differ¬ 
ences in behavior are attributed to various exciting circumstances 
(“frightened,” “angry,” and “embarrassed”). 

Traits of this sort are simply a way of representing the repertoire 
of an organism, with some indication of the relative strength of its 
parts and with certain inferences regarding relevant variables. The 
“tests” which measure such traits are inventories, which list responses 
falling within certain classes and estimate their relative frequencies 
of occurrence. Surveys of attitudes and opinions are usually of this 
sort, as are tests of achievement. The Kinsey reports on sexual behav¬ 
ior are surveys of frequencies of certain types of responses from which 
we may infer certain conditions of deprivation, a history of sexual 
reinforcement, and the health and hereditary endowment of the 
organism. 


Differences in processes. A second kind of difference in behavior 
arises from a difference in the rate at which changes in behavior take 
place. The “intelligent” individual, for example, is commonly sup¬ 
posed to show more rapid conditioning and extinction, to form dis¬ 
criminations more rapidly, and so on. The resulting effect upon 
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behavior is not always distinguishable from tliat of “experience.” 
When an individual scores high on an achievement test, the result 
may be traced either to an exposure to certain variables or to the rate 
at which these variables have taken effect or to both. \'ocabular\' 
tests, for example, presumably reflect differences both in exposure 
and in rate of conditioning. When we distinguish between the 
“phlegmatic” and the “sanguine” or “the slow-to-angcr” and the 
“truculent,” the differences arc not in degree of deprivation or emo¬ 
tional circumstances but in the speed with which behavior changes 
as a function of such circumstances. 

Traits of this second sort cannot be measured by an inventory. 
If wc want to know simply whether a given set of conditions will 
make a man angry- or lead him to take any other sort of action, a 
survey of his behavior under those conditions will suffice. If. how¬ 
ever, we want to know how quickly he becomes angiy or how alertly 
he takes action, we need a measure appropriate to a functional proc¬ 
ess. Differences of this second sort can eventually be expressed in 
quantitative form as differences in the values of certain constants in 
the equations describing the appropriate processes. Once these values 
are available, they will characterize an individual just as the physical 
constants of thermal conductivity, electrical conductivity, specific 
gravity, and so on characterize materials. (It is significant that these 
“individual differences” among physical objects were once attributed 
to essences or principles which strongly resemble traits as the term 
is now commonly used.) 

Traits which can be reduced to inventories of behavior, to the rela¬ 
tive strengths of parts of a repertoire, or to the speed with which 
behavioral processes take place have acceptable scientific dimensions, 
and their relation to a functional analysis is clear. Those who are 
currently engaged in the study of traits, however, almost always 
quantify their data in a quite different way. The intelligence test is 
a classic example. Wlien a man takes such a test, he makes a score. 
This is numerical, but it is not an acceptable measure of a trait 
because it is arbitrary; it depends upon the length of the test, its 
nature, the time allowed in taking it, and so on. To obtain a less 
arbitrary measure, the same test is given to a number of people under 
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comparable conditions, and each raw score is converted into a stand¬ 
ard score which gives the position of the individual with respect to 
the group. Even this standard score is not a quantitative measure of 
a trait; it simply shows that the performance of an individual exceeds 
that of a certain percentage of the group. But the group is, like the 
original score, arbitrary'. Trouble will arise when we try to use such a 
measure in a different group. 

The difference between a measure based upon a population and a 
measure based upon frequency of response is clear when we consider 
a population of only one man. Robinson Crusoe, before the advent 
of his man Friday, must have shown a certain repertoire of behavior, 
certain frequencies of response, and certain rates of change in fre¬ 
quency. Occasionally he must have been hungry in the sense of being 
inclined to eat at a given rate, angry in the sense of being disposed to 
injure animals or objects, and intelligent in the sense of being quick 
to solve the problems of his daily life. His behavior must have been 
modified at given rates as the result of certain contingencies. He must 
have been able to discriminate stimuli of given complexities or subtle¬ 
ties. All this he himself might have observed and measured in a quan¬ 
titative way. He could not, however, have measured his own I.Q., 
since he could not have devised a test on which his score would be 
divested of the arbitrary features of length, level of difficulty, or 
allotted time. 

The use of a population to measure a trait is illustrated by a scale 
commonly used to designate the hardness of minerals. The scale 
ranges from 1 (talc) to 10 (diamond). When we say that quartz has 
a hardness of 7, we mean that it will scratch or cut all minerals hav¬ 
ing a hardness of 6 or less, and that it in turn can be cut by minerals 
of hardness 8, 9, or 10. If the world were constructed of quartz alone, 
the number 7 would have no significance. Such a scale is unquestion¬ 
ably useful for technological purposes, but it does not greatly advance 
the study of the hardness of minerals. The physicist accounts for dif¬ 
ferent positions on the scale as differences in molecular structure. A 
measure of the hardness of quartz expressed in terms of structure is 
meaningful without reference to minerals of other hardnesses. Insofar 
as we can express differences in intelligence as differences in reper- 



FUNCTION VERSUS ASPECF 199 


toire, in exposure to variables, or in rates of change, our measure is 
similarly independent of a population. 

PREDICTION IN I’ERMS OF TRAITS 

A test is simply a convenient opportunity to obser\’e behavior—to 
survey or sample our dependent variable. The score may be used to 
predict some aspect of the larger universe of behavior from which the 
test is drawn. Thus a test of mechanical ability, or intelligence, or 
extroversion may enable us to predict success or failure in a job in 
which these traits are important. But the causal relation invoked in 
this kind of prediction is not the same as that which appears in a 
functional analysis. Certain variables in the history of the individual 
and in the current environment arc responsible for the behavior in 
the test situation, and they also determine the behavior in the larger 
situation. The prediction is not from cause to effect, but from one 
effect to another. This is shown by the fact that we use tests as a basis 
for prediction without knowing what variables are responsible for the 
score obtained or for the behavior predicted. It is shown also by the 
fact that if we extend a test without limit, adding more and more 
items, it eventually coincides with the behavior to be predicted. No 
true prediction then survives. There is no way in which we could 
extend a true independent variable so that it would become identical 
with the dependent variable in a functional analysis. 

A prediction from effect to effect is, of course, sometimes useful. 
It may enable us to dispense with the direct observ'ation of variables. 
This is particularly important when the variables are clearly out of 
reach. For example, whether an individual shows certain patterns of 
behavior characteristic of his species or where he stands with respect 
to other members of his species in relative frequency of response, as 
in the Kinsey reports, can at the moment be determined only through 
a survey, since we have no direct control over the independent vari¬ 
ables. A complete surv'ey of such behavior would be easily under¬ 
stood; an incomplete survey constitutes a “test” from which the result 
of a complete survey may be inferred. 

We may also find it convenient to survey the current effects of 
variables which, though manipulable, lie in the remote history of the 
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individual. We use body weight as a current indication of a history 
of food deprivation in predicting the probability that an experimen¬ 
tal animal will eat, and we might use some collateral test of the “trait 
of voracity” for the same purpose. Rate of eating in a test situation 
would enable us to predict rate of eating in a larger experimental 
situation. Similarly, by making an inventory of current aggressive 
tendencies, we may dispense with the possibly difficult study of early 
environmental factors responsible for aggressive behavior. 

The principal advantages of a functional analysis are lost, however, 
when we resort to these alternative practices. Perhaps the most con¬ 
spicuous feature of an aspect-description is its failure to advance the 
control of behavior. By measuring a set of traits, we judge the suit¬ 
ability of an individual to a given task, but the only practical step is 
to accept or reject him. The measurement of the trait does not sug¬ 
gest a way of altering his suitability to the task, for it does not bring 
us into contact with variables which may be manipulated in gener¬ 
ating or eliminating the behavior which it describes. The only prac¬ 
tical advantage we gain is that we may make better use of relevant 
variables already in our possession. 

Instead of predicting performance from the test of a trait, we may 
be interested in predicting one trait from another or from some other 
sort of variable. Thus a personality in all its manifestations is often 
attributed to the physique of the organism, a relation which is pre¬ 
sumably capable of being expressed trait by trait. Often personality 
is attributed to variables which are immediately controllable. For 
example, the “oral,” “anal,” and “erotic” personalities of Freud refer 
to groups of traits which are assumed to have been generated by the 
early history of the individual—a history which is presumably modi¬ 
fiable, if taken in time, or at least capable of being masked by a later 
history superimposed upon it. A similar controlling relation is sug¬ 
gested for a single trait when it is asserted that aggressiveness is a 
function of frustration. There are, however, certain inherent limita¬ 
tions in a functional analysis in which the dependent variable is a 
trait. 

The usefulness of any lawful relation depends upon the sharpness 
of reference of the terms in which it is stated. We may predict and 
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control only as much as we specify in our laws. We have seen that 
there are practical circumstances under which it may be useful to 
predict traits, but in general the trait-name tells us little about behav¬ 
ior. It is not only the lack of specificity, however, which makes the 
trait-name unsuitable for a functional analysis. In the chapters which 
follow we shall turn to certain complex processes. Interlocking sys¬ 
tems of responses will be traced to complex arrangements of variables, 
and a workable conception of the individual as a responding system 
will be set up. The trait-name does not refer to a unit of behavior 
which makes such an analysis possible. 

The fact that a conception of the individual as a behaving system 
seems to lie beyond the reach of an aspect-description is exemplified 
by a practical problem in current clinical psycholog)'. Through an 
extensive use of tests and other measurements of aspects of behavior 
the individual is characterized for diagnostic purposes. But the result¬ 
ing information is of little or no help in therapy—in dealing with the 
individual as a dynamic system. The clinician must turn from a 
“psychograph” of the personality to “common sense” or to an entirely 
different conceptual system such as that of psychoanalysis, which, as 
we shall see later, is similar to a functional analysis. Currently, little 
or no effort is being made to reconcile these two ways of dealing with 
human behavior, perhaps because a reconciliation seems hopeless. 
The measurement of aspects of behavior is likely to be associated 
with the belief that the business of science is primarily to supply 
information which is then used to further the art of dealing with 
people, not only in the clinic, but in salesmanship, education, family 
counseling, labor problems, diplomacy, and so on. But the special 
wisdom which this art presupposes, the special insight into human 
behavior which is needed to make effective use of such information, 
is precisely what a functional analysis supplies. 

We are all thoroughly familiar with descriptions of behavior in 
terms of traits, and trait-names are an extensive part of our daily 
vocabulary. As a result, we feel at home in describing behavior in this 
way. But the familiarity is misleading. Tlie fact is that we can pre¬ 
dict and control a response much more readily than a trait. A re¬ 
sponse is easier to define and identify, and its probability varies more 
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sensitively. Even when we define a trait as a group of responses, the 
unity or coherence of the group needs to be proved. Do all the re¬ 
sponses which are taken to be evidences of aggressiveness, for ex¬ 
ample, sar)' together with a given condition of frustration? And are 
all conditions of frustration equally effective? In order to be sure of 
the unity of the trait, we have to show that each of the acts which 
‘'expresses” it is controlled by each of the conditions specified as its 
cause—that each aggressive act, for example, is controlled to the same 
degree by every condition which can be described as frustrating. But 
this is the program of a functional analysis. We have not reduced the 
labor of such an analysis by resorting to summary statements in terms 
of traits. 

Almost any characteristic may be set up as a dimension of the per¬ 
sonality, but this extended coverage is of little value until something 
is achieved beyond mere naming. The additional work required to 
establish traits as scientific categories is just as laborious and just as 
detailed as the analysis of discrete responses. The effort required to 
make any account comprehensive is determined by the subject matter 
itself. Unfortunately, behavior is complex. 


ff it 


TRAITS ARE NOT CAUSES 

Trait-names usually begin as adjectives—“intelligent, "aggressive 
“disorganized,” “angr)',” “introverted,” “ravenous,” and so on—but 
the almost inevitable linguistic result is that adjectives give birth to 
nouns. The things to which these nouns refer are then taken to be 
the active causes of the aspects. We begin with “intelligent behavior,” 
pass first to “behavior which shows intelligence,” and then to “behav¬ 
ior which is the effect of intelligence.” Similarly, we begin by observ¬ 
ing a preoccupation with a mirror which recalls the legend of Nar¬ 
cissus; we invent the adjective “narcissistic,” and then the noun 
“narcissism,” and finally we assert that the thing presumably referred 
to by the noun is the cause of the behavior with which we began. 
But at no point in such a series do we make contact with any event 
outside the behavior itself which justifies the claim of a causal con¬ 
nection. 

Efforts have been made to put the matter in better scientific order 
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by establishing the validity of the trait as a conceptual cause. A search 
for the smallest number of traits which will “explain” behavior has 
worked in this direction. Since trait-names come from many sources 
and may be multiplied at will, the kinds of behavior to which they 
refer often overlap. The overlap may be discovered by analyzing the 
forms of behavior specified in tests of two traits or by showing that 
the result on one test enables us to prediet the result on another. 
When two traits are found to be almost identical, one is simply 
dropped. When the overlap is not complete, we appear to be meas¬ 
uring a trait which is common to both tests, yet not measured exclu¬ 
sively by either one. The trait therefore appears to have different 
dimensions from the behavior from which it is inferred, and this fact 
has encouraged those who are concerned with finding a minimal set 
of these causes. 

The smallest number of traits needed to account for the perform¬ 
ances of a group of people on a number of tests may be determined 
through certain mathematical procedures. From such a result we may 
say that a given individual does well in one group of tests because he 
possesses a certain amount of a certain trait, and on another group of 
tests because he possesses a certain amount of a different trait. Since 
these procedures take us some distance away from the obscr\'ed data, 
it is tempting to identify the resulting traits or factors with physio¬ 
logical states or psychological faculties and to give them additional 
dimensions not found in the measures of behavior from which they 
were inferred. Regardless of the length of the mathematical pioce- 
dure, however, a trait or factor is derived from the observation of the 
dependent variable only. This limitation is not changed by any math¬ 
ematical operation. A fairly exhaustive set of tests may enable us to 
evaluate traits and to predict performances in a wide range of situa¬ 
tions, but the prediction is still from effect to effect. The mathemati¬ 
cal refinement has not brought the trait under control. We do not 
change behavior by manipulating a trait. 



CHAPTER ^lY 


THE ANALYSIS OF 
COMPLEX CASES 


“OVERSIMPLIFICATION" 

In a scientific analysis it is seldom possible to proceed 
directly to complex cases. We begin with the simple and build up to 
the complex, step by step. In its early years any science is vulnerable 
to the charge that it neglects important instances. Boyle’s Law, relat¬ 
ing the volume of a gas to its pressure, was a significant advance in 
knowledge, but a contemporary critic could easily have denounced it 
as a flagrant oversimplification. It was only necessary to vary the tem¬ 
perature to show that volume was not simply a function of pressure. 
When the temperature was specified in a new version of the law, 
more precise measurements could still show that there were discrep¬ 
ancies between different gases, and a “gas constant” had to be added 
to the equation. There is nothing wrong with this sort of patchwork; 
it is the way scientific knowledge grows. 

In a science of behavior we begin in the simplest way. We study 
relatively simple organisms with relatively simple histories and under 
relatively simple environmental conditions. In this way we obtain the 
degree of rigor necessary for a scientific analysis. Our data are as 
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uniform and reproducible as, say, the data of modem biolog)'. It is 
true that the simplicity is to some extent artificial. We do not often 
find anything like it outside the laboratoiy —especially in the field of 
human behavior, which is of primaiy- interest. As a result those who 
arc impatient to get on to bigger issues are inclined to object to the 
“oversimplified” fonnulations of the laborator)'. I’heir objections take 
the fonn, as in the example of Boyle’s Law, of setting forth apparent 
exceptions to the rule. Such criticism is useful if it points to facts 
which have been unseen or ignored. But ver)’ often the exceptions 
are only apparent; the existing formulation is capable of giving a 
good account of them when properly applied. 

A common source of misunderstanding is the neglect of what hap¬ 
pens when variables are combined in different ways. Although a func¬ 
tional analysis begins with relatively isolated relations, an important 
part of its task is to show how its variables interaet. Several important 
cases will be discussed in the present chapter. 

MULTIPLE EFFECTS OF 
A SINGLE VARIABLE 

A given event may have two or more kinds of effects upon behavior 
at the same time. In the analysis of punishment in Chapter XII it was 
seen that a single aversive stimulus contingent upon a response has 
at least four effects. (1) It elicits reflexes, often of an emotional 
nature. (2) It alters emotional predispositions to act in various ways. 
(5) It serves as a reinforcing stimulus in respondent conditioning 
when paired with stimuli which precede or accompany it; these stim¬ 
uli eventually evoke the responses and predispositions of (1) and 
(2), and any avoidance behavior which brings the stimuli to an end 
is reinforced. (4) It makes possible the reinforcement of any escape 
behavior which brings the punishing stimulus itself to an end. In this 
example, then, a single event seiA'es as an eliciting stimulus, an emo¬ 
tional operation, a reinforcing stimulus in respondent conditioning, 
and a negative reinforcer in operant conditioning. 

It would be meaningless to say that an event has two or more 
effects if we could not separate them. Wlien the effects are felt at 
different times, this is not diflEcult. For example, a reinforcement 
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may be of such magnitude that considerable satiation takes place. 
TIic strengthening effect of the reinforcement may be temporarily 
concealed by the weakening effect of satiation. Thus a single, rela¬ 
tively large payment of wages may produce such a degree of satiation 
that the worker does not work again for some time, but the reinforc¬ 
ing effect of the wage will become evident when a sufBcient depriva¬ 
tion again arises. 

A common objection to the Law of Effect provides another ex¬ 
ample. The doctrine of “need-gratification" in psychotherapy is based 
upon the fact that behavior which has been strengthened by depriva¬ 
tion is weakened by satiation. Satiation thus becomes a clinical pro¬ 
cedure. For example, behavior which is strong because it has been 
reinforced with personal attention may be weakened if the indi¬ 
vidual receives attention or if the primary deprivations responsible 
for the reinforcing power of attention are reduced. Similarly, behavior 
which is strong because it gets affection can be weakened by giving 
affection or appropriate primary reinforcers. It has been argued that 
these results contradict the Law of Effect, which appears to predict 
that the behavior should be strengthened rather than weakened. But 
the case is easily formulated in terms of the multiple effects of giving 
attention or affection. A child who is behaving in an asocial fashion 
to draw attention to himself may be “cured" by a sizable measure of 
attention if satiation takes precedence over reinforcement, as it may. 
But what will happen when deprivation again arises? If the “cure" 
sends the patient back for more attention or affection, a reinforcing 
effect is obvious. (This can be avoided. If a certain “need-gratifica¬ 
tion" is prescribed, it should be given when the patient is not mis¬ 
behaving. This will produce satiation without reinforcing undesirable 
behavior.) 

An objection which has been raised to the principle of satiation 
supplies an example of a different set of multiple effects. Suppose we 
approach a child who is playing happily by himself and give him a 
small piece of candy. We may observe the sudden emergence of a 
great deal of objectionable behavior—asking and teasing for more 
candy, then crying, and perhaps even a temper tantrum. We appear 
to have increased his candy-hunger, although our definition of satia- 
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tion implies that we have decreased it, at least by a small amount. 
The explanation is that the candy has had a second effect. The sight 
and taste of candy are discrwimative sthnuli under which the behav¬ 
ior of asking or reaching for candy is frequently effective. There is 
no likelier occasion for the reinforcement of such behavior than the 
immediate presence of candy. By giving the child a small amount of 
candy, we establish a common situation in which powerful behavior 
under the eontrol of candy-deprivation is usually effective and hence 
strong. We have not made the child any hungrier in terms of depri¬ 
vation. With a given history' of deprivation the behavior of begging 
for candy shows two levels of strength under the control of two stim¬ 
uli. In our experiment we change from the stimulus which controls 
the low level to that which controls the high. Another result then 
follows. A small piece of candy, as a discriminative stimulus, evokes 
behavior which is usually reinforced, but we have specified that it is 
not further reinforced in the present case. Not only does the child ask 
for candy; he asks unsuccessfully. This is the condition for an emo¬ 
tional reaction of “frustration,” in which the child begins to cry' and 
perhaps ends with a temper tantrum (Chapter X). It is obvious that 
the child was free of these behaviors before seeing the candy, but this 
does not mean that he was not hungry. If we were to define hunger 
in terms of strength of behavior regardless of the presence or absence 
of discriminative stimuli, we should have to agree that a small 
amount of food increases it. But the case is not an exception to the 
present formulation. 

We can separate the discriminating and satiating effects of the 
candy in several ways. For example, a regimen in which a child is 
never given more than a single piece of candy at a time will even¬ 
tually extinguish the behavior of asking for more. As a result, the 
condition responsible for cry ing or a temper tantrum will not arise. 
A single piece of candy will have none of the disturbing effects de¬ 
scribed in this example, and it should be possible to demonstrate a 
small measure of satiation. 

A somewhat more important parallel also shows how easily “drive” 
is identified with probability of response rather than with a proba¬ 
bility due to deprivation. An individual in whom sexual behavior is 
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at the moment not conspicuous may be aroused by exciting conver¬ 
sations, pictures, performances, and so on. It is not correct to say that 
his sex drive has then been strengthened. Sexual behavior has been 
strengthened, but by the presentation of stimuli appropriate to such 
behavior rather than by deprivation. 

An operation may have two effects which change the probability 
of behavior in the same direction. For example, when a response has 
been reinforced consistently with food but now goes unreinforced for 
tlic first time, the probability due to previous reinforcement is de¬ 
creased and emotional changes in behavior characteristic of frustra¬ 
tion arc generated. Since the latter include the weakening of any 
behavior reinforced with food, the first few responses in extinction 
will be followed by a reduction in rate for two reasons. For a time 
\ cr\- few responses will be emitted and hence very few will go unre- 
inforccd. I’he emotional effect will therefore not be sustained, and 
the rate will rise, only to fall again as further responses go unrein- 
forccd. I’he result is, as we have seen, an oscillation in rate which 
gives the extinction cune a wavelike character. 

At first blush it may seem difficult to separate these effects experi¬ 
mentally. We may, however, demonstrate the emotional effect by 
frustrating the organism in some other connection. We may also 
make use of the fact that emotional reactions eventually “adapt out.” 
By repeatedly extinguishing and reconditioning a response, particu¬ 
larly on a schedule of intermittent reinforcement, we obtain extinc¬ 
tion curves with little or no interference from emotional effects. We 
mav also use the fact that an emotional effect involves the whole 
repertoire of the organism, while extinction is fairly narrowly local¬ 
ized in the response not reinforced. It is possible to record the fre¬ 
quency of emission of two responses in the same organism at the 
same time. If the responses do not use the same musculature to any 
great extent, their changes in rate may show a surprising independ¬ 
ence. In the pigeon experiment pecking a key and stepping on a pedal 
satisfy these conditions reasonably well. A somewhat more conven¬ 
ient arrangement is to suspend the pigeon in a harness with one leg 
free; the pecking response and the flexion of the leg can then be sep¬ 
arately but simultaneously studied. When these two responses have 
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been conditioned, they can be extingiiislicd at tlic same time except 
for a slight delay in one process. The extinction cuiA'es, recorded sep¬ 
arately, are slightly displaced in time, but the major oscillations occur 
simultaneously. This suggests that the rise and fall of frustration is 
a single process in the whole organism, while the change due to 
extinction is separately determined in each response. 

MULTIPLE CAUSES 

Another way in which independent variables may interact is of 
greater importance. Two or more operations may combine in a com¬ 
mon effect. We have already discussed several examples. An operant 
may be reinforced in more than one way, with the result that it 
varies with more than one deprivation. This is, in fact, the effect of 
a generalized reinforcer. A response so conditioned is not only more 
likely to be strong at any given time, because at least one state of 
deprivation is likely to prevail, but it may have an especially high 
probability of emission if two or more states of deprivation prevail 
at the same time. A similar result is achieved if two or more rein¬ 
forcements are directly applied to a single operant. The principle is 
used when attendance at the business meeting of a club is encour¬ 
aged by the serxdng of refreshments. Although a member may not 
attend because of the refreshments alone or because of participation 
in the business meeting alone, he will be more likely to attend if the 
probabilities due to both of these reinforcements are combined. 

Emotional variables are frequently combined with variables in the 
fields of motivation and conditioning. Contrary to several well- 
established views there is no fundamental opposition between emo¬ 
tion and the '‘intellectual" behavior of the discriminated operant. 
Behavior is often most vigorous and effective when an emotional pre¬ 
disposition works in the same direction as a contingency of reinforce¬ 
ment. This is implied when we say that “a man’s heart is in his 
work," where “heart” refers to emotional variables and “work” to 
contingencies of reinforcement. The individual in whom aggressive 
or brutal behavior is particularly strong may work especially well in 
certain kinds of employment—for example, in certain kinds of police 
or military work. An actress whose role required her to slap another 
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person in a play slapped with unusual force when she became angry 
with him for extraneous reasons. The individual with an “affection¬ 
ate" disposition may be especially successful at jobs which are con¬ 
cerned with helping other people. 

In an important application of this principle, one discriminative 
stimulus is combined with another discriminative stimulus or with 
other variables. The effects are of various sorts. Some are commonly 
called “suggestion," others are dealt with as “projective techniques," 
while still others are important in the field of perception. Verbal 
behavior supplies particularly good examples.' A single verbal re¬ 
sponse is especially likely to be a function of more than one variable 
because it may be part of several different repertoires. In simple imi¬ 
tative or echoic behavior the response is controlled by a verbal stimu¬ 
lus of similar form—the verbal stimulus “house” evokes the verbal 
response “house.” When the verbal stimulus is of different form—as 
in the word-association experiment—we may speak of an intraverbal 
repertoire—the stimulus “home” evokes the response “house.” In 
reading, the stimulus is a text—the printed stimulus “house” evokes 
the vocal response “house.” A great deal of verbal behavior is con¬ 
trolled by nonverbal stimuli, as when we name or describe objects and 
the properties of objects—an actual house evokes the response 
“house.” Since a single verbal response usually comes under the con¬ 
trol of variables in all these fields, in addition to its relation to emo¬ 
tional and motivational conditions, it is likely to be a function of 
more than one variable at a time. 

TTie presence of more than one stimulus variable in verbal behav¬ 
ior is sometimes dealt with as “multiple meaning.” The term is too 
narrow for our present purposes, for we must include contributions 
of strength from variables which are usually not included in the 
“meaning” of a response—for example, in the echoic response or the 
textual response to a printed word. A newspaper article about a con¬ 
vention of dentists reported that, in order to improve their profes¬ 
sion, the dentists were urging the passage of certain laws “with teeth 

* For an extensive analysis of verbal behavior from this point of view see 
B. F. Skinner, 'Verbal Behavior, Harvard University Press, Cambridge, Massachu¬ 
setts. (In preparation.) 



THE ANALYSIS OF COMPLEX CASES 211 


in them.” Tlic circumstances under which this was written might 
have led to alternative responses such as “laws with appropriate pen¬ 
alties” or “laws which could be enforced.” These responses might 
have been equally probable if another profession had been under 
discussion. The response “with teeth in them” probably emerged 
because of the additional strength of the response “teeth”; a particu¬ 
lar synonym had taken precedence over equivalent forms because of 
a multiple causation. Similarly, when a writer discussing a man who 
had been in China hunting for pandas reported that his plans had 
not “panned out,” the expression appears to have taken precedence 
over such synonyms as “worked out,” “come to anything,” or 
“materialized,” because of a contribution of strength from the vari¬ 
ables responsible for “panda.” 

The multiple determination of verbal behavior is the basis of much 
wit. The witt}' response differs from the unconsciously amusing to 
the extent that the speaker is able to respond to the multiple sources 
of strength and to point them up by a proper elaboration. Wc are 
concerned here merely with the multiple sources of the witty cle¬ 
ment, not with the complete joke. An example is a stor)' told of Dean 
Briggs of Har\’ard. The Dean was speaking at a dinner on an uncom¬ 
fortably hot evening. The chairs had recently been varnished, and 
when the Dean rose to speak, he found his coat stuck to the chair. 
There was a good deal of laughter as he pulled it loose. When he was 
at last able to speak, he began, “I had expected to bring to you this 
evening an unvarnished tale, but circumstances make it impossible 
to fulfill my expectations.” The multiple sources of “unvarnished 
tale” are essentially the same as those in the preceding examples, but 
the Dean was able to construct a sentence which made the multiple 
causation of the response clear to everj'one. 

All sustained verbal behavior is multiply determined. When a man 
begins to speak or write, he creates an elaborate set of stimuli which 
alter the strength of other responses in his repertoire. It is impossible 
to resist these supplementary sources of strength. We cannot, for 
example, call out a random series of numbers. Various sequences of 
numbers are reinforced as we learn to count by ones, twos, threes, or 
fives, to recite multiplication tables, to give telephone numbers, and 
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SO on. When we call out a 6rst number, therefore, we alter the prob¬ 
abilities determining the next call. When a series of some length has 
been emitted, later numbers may be extremely powerfully deter¬ 
mined. 

In the same way, any sustained sample of verbal behavior estab¬ 
lishes strong predispositions among the responses still to come. Our 
imitative or echoic repertoire produces rhyme, rhythm, assonance, 
and alliteration, which may appear simply as a disturbing singsong 
or. as in the parallel case of wit, may be elaborated into poetry'. Ver¬ 
bal material we have memorized and familiar collocations of words 
in eveiyday use establish intraverbal tendencies which add other 
supplementary strengths. The literary artist exploits these when he 
fashions a poem or constructs a convincing argument. He builds 
multiple tendencies in the reader by virtue of which the reader finds 
himself unaccountably predisposed to “chime in” with the rhyming 
word of a poem or the clinching word of an argument. 

Occasionally, verbal behavior is actually distorted by this sort of 
multiple determination. We may be able to give a plausible account 
of the variables responsible, but the speech itself is not always effec¬ 
tive. Many years ago a young woman was asked to speak at a dinner 
advocating the repeal of the Prohibition Amendment. It was her 
first public appearance, and she was extremely ill at ease. As she rose 
to speak, someone placed a microphone in front of her. It was an 
unfamiliar and frightening instrument. She decided to throw herself 
on the mercy of the audience and plead her inexperience. Her first 
words were, “This is the first time I have ever faced a speakeasy.” The 
intruding “speakeasy,” which was as much a surprise to the speaker 
as to her delighted audience, may be traced to several contributing 
variables: her subject was in part the evils of the speakeasy, she was 
concerned with her own ability to speak easily, and a microphone 
could be called a speakeasy in the sense that it enables one to speak 
to many people with little effort. We shall see later that the intrud¬ 
ing response may also have reduced aversive stimulation from the 
incipient response microphone.” We could presumably have shown 
that the stimulus microphone” would elicit some of the emotional 
reflexes which, as in the case of the lie detector, are typical of aver- 
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sive stimuli. We do not say that the response “microphone” liad a 
tendency “not to be emitted,” but rather that any response wliich 
displaced it would be strong for that reason. Because of this over¬ 
whelming strength, the response broke into the speech in progress. 
In spite of the disruption the sources of strength were so obvious that 
the total response was not without an effect, and it was accepted 
as wit. 

A different kind of distortion arises when two or more fairly similar 
forms of response are strengthened. One may prevail as the result of 
both sources of strength, or a combined form may be generated. 
Folk etymologies (“sparrow grass” for “asparagus”) and blends 
(“smog” for “smoke” and “fog”) or the portmanteau words of Lewis 
Carroll (“frumious” for “furious” and “fuming”) are examples. Some 
distortions are sufficiently effective to sur\dve in the verbal behavior 
of the community, but others (such as “ur\'ing” for "urge” and 
“craving” or “heritage” for “heresy” and “sacrilege”) suffer a sadder 
fate. 


THE PRACTICAL USE OF 
MULTIPLE CAUSATION 

Supplemental^' variables are often used in controlling behavior. 
A familiar case is “suggestion,” which may be defined as the use of 
a stimulus to raise the probability of a response already assumed to 
exist at some low value. Verbal suggestions may be classified accord¬ 
ing to the kind of supplementary stimulation. In the imitative or 
echoic case, we strengthen a response by supplying stimulation of 
the same form. We may call this formal suggestion. When we 
strengthen a response with nonverbal stimuli or verbal stimuli of 
different form, the suggestion is thematic. A cross-classification may 
be set up according to whether the response can or cannot be iden¬ 
tified in advance. If we call the first a "prompt” and the second a 
“probe,” then we have to consider formal prompts, formal probes, 
thematic prompts, and thematic probes. 

The formal prompt is the common practice in the theater, A word 
whispered in the wings strengthens the verbal behavior of the actor 
by setting up an echoic response which combines with the imper- 
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fcctly memorized beliavior. If the part has not been memorized at 
all, the actor repeats what he hears from the prompter merely as an 
echoic response. Since there is then only one source of strength, it is 
not prompting in the present sense. It is difficult to be sure of mul¬ 
tiple sources if the prompter supplies the whole passage, but two 
variables are obviously at work if he does not. TTie relative strength 
of learned material is shown by how much of a prompt is required: 
if the passage has been fairly well memorized, a very small echoic 
contribution will suffice. Radio and television quiz programs use a 
kind of concealed formal prompt. The contestant who finds it diffi¬ 
cult to answer a question may be helped if the master of ceremonies 
makes a remark containing a word which is similar to the answer. 
If the answer is, say, "Washington," the concealed prompt might 
contain the word "washing." 

A thematic prompt having the same effect would be a remark con¬ 
taining the words, "Father of his Country." When we acquire intra- 
verbal behavior like "Washington was the Father of his Country, we 
show an increased tendency to say "Washington" when "the Father 
of his Country” is heard. Neither the formal nor the thematic prompt 
will be effective if the response “Washington” does not already exist 
in some strength. If the contestant is simply told the answer and 
says "Washington," this is echoic behavior, and no prompting in the 
present sense has taken place. The thematic prompt is ordinarily 
called a "hint.” Hinting, as a type of suggestion, always involves the 
use of a supplementary variable in rendering a given response more 
probable. 

A formal probe which supplements verbal behavior of unknown 
form utilizes a process which has long been familiar. We may be 
interested in the behavior which it reveals because of the light which 
is thrown on other variables. Ambitious young Dick Whittington, 
discouraged by his failure in London, leaves the city, but as he walks 
away he hears Bow Bells tolling the words, "Turn again, Whitting¬ 
ton, thrice Lord Mayor of London town." TTie stimulus from the 
bells must have been only vaguely similar to this response. No one 
else would have heard them saying the same thing. The words rep¬ 
resent strong responses in the ambitious Whittington’s own behav- 
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ioL to wliich the echoic supplement supplied by the sound of the 
bells gave the strength needed for emission, (d iie fact that WHiit- 
tington heard the bells speak is a separate point to which we shall 
return later. The only speaker was Whittington himself.) The effect 
has often been used in literature; a young girl running away from 
home hears the click of the wheels of the train saying, “Why arc you 
here? W’hy arc you here?”; the lapping of water against the side of a 
boat whispers, “He speaks the truth. lie speaks the truth.” 

A device called the Verbal Summator, which is used experimen- 
tallv and clinically to probe latent verbal behasior, uses the same 
process. \^ague speech patterns—‘‘eyc-uh-c//j-iih” or “oo-ee-uh-uh,” 
for example—are repeated by a phonograph so softly or against so 
noisy a background that they resemble barely audible speech. The 
subject is asked to listen to each repeated pattern until he hears 
“what is said.” The feeble echoic response generated by the repeated 
auditor)' stimulus combines with a \crbal response already in some 
strength. The resulting response is often emitted with great confi¬ 
dence. A subject may respond to hundreds of different patterns while 
remaining convinced that they are genuine speech and that he is 
usually identifying them correctly. An extensive sample of latent 
verbal behavior may thus be collected which, since it bears little 
relation to the stimulating situation, must be the product of other 
variables in the behavior of the subject. The clinical use of the 
material is based upon the assumption that these variables—in the 
fields of reinforcement, motivation, or emotion—are probably impor¬ 
tant in interpreting other behavior of the individual. 

A thematic probe is exemplified by the so-called word-association 
experiment. This is similar to the Verbal Summator except that the 
supplemental:)' strength is derived from intraverbal responses. A stim¬ 
ulus word is spoken or shown to the subject, and he is asked to report 
“the first word he thinks of” or, as we should say here, to emit aloud 


the first verbal response which appears in his behavior. Many differ¬ 
ent responses are strengthened by an intraverbal stimulus. For 


example, the stimulus “house” may evoke “home,” “building,” 


“keeper,” and so on. Which of these is emitted at a particular time 


is presumably determined by a relatively effective additional source 
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of strength. When verbal behavior is collected in this way, it is pos¬ 
sible to infer some of the verbal history of the subject, as well as cur¬ 
rent variables responsible for his interests, his emotional predisposi¬ 
tions, and so on. The clinical use of this material is based upon the 
assumption that these variables are relevant in interpreting other 
behavior. The supplementary strength of the thematic probe is not • 
always intraverbal. We may strengthen verbal behavior simply by 
presenting pictures, objects, or events and asking our subject to talk 
about them. 

By asking our subject to talk in a minimal stimulating situation 
we generate the condition for what is known as free association, 
which docs not necessarily exemplify the present process. The verbal 
behavior obtained may be maximally controlled by variables in his 
history, and inferences about these variables may be of optimal value; 
but since no supplementary source of strength is used, the case is not 
classified as cither a formal or thematic probe. A great deal of self¬ 
probing may go on, however, when parts of such a verbal production 
alter other parts through supplementary stimulation. 

PROJECTION AND IDENTIFICATION 

Formal and thematic probes are frequently called “projective tests,” 
but the word “projection” has a broader significance. Freud described 
the process to which it refers as a way in which repressed wishes work 
themselves out (Chapter XXIV). A similar mechanism is called “iden¬ 
tification.” Quite apart from any analysis of wishes, we may classify the 
behavior in terms of its relevant variables: certain occasions for verbal 
or nonverbal behavior join forces with behavior already in some 
strength. When we “identify” ourselves with the hero of a novel, 
movie, or play, or “throw ourselves into a character,” we simply 
behave in the same way —that is, imitatively (Chapter VII). When 
our imitative behavior is so microscopic as to be wholly private, a spe¬ 
cial problem may arise, as we shall see in Chapter XVII. The imitative 
supplement may be either verbal or nonverbal, but the verbal behavior 
has several advantages. For example, in reading a novel we can more 
easily identify ourselves with the character who is speaking than with 
someone behaving nonverbally because the recorded speech provides 
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a direct source of strength for verbal responses and because tliese 
responses can be executed in any environment. A widespread prefer¬ 
ence for conversation in novels seems to be due to this fact. 

*^riic behavior wliich is executed in identification must base some 
strength for other reasons. If the strength is considerable, we lia\e to 
explain why the response is not emitted without supplementation. 
In a common case tlie beha\ ior cannot be emitted in everyday life 
because the opportunity is lacking or because the behavior is re¬ 
strained or punished. A tendency to identify oneself with, say, a fic¬ 
tional character may be clinically significant as evidence of the 
strength of the behavior. It is often the case, however, that a stor) 
simply builds up a tendency; the author forces a sort of identification, 
which is evident in the fact that interest in a character grows as the 
stoi^' unfolds. Such an identification may have little bearing upon 
variables operating elsewhere in the reader’s life. 

We speak of projection, rather than identification, when the be¬ 
havior is less specifically controlled by the supplcnientar\' stimulus. 
A classic example is the lover who accuses his beloved of coolness or 
unfaithfulness because he himself has grown cool or unfaithful. The 
lover has reacted with a response which is formally imitative of the 
behavior of the other person but which is controlled by quite different 
variables in his own behavior. For example, remaining silent for 
some trivial reason is imitated and combined with a gesture of bore¬ 
dom; a passing comment is echoed and combined with a critical 
remark. In what is sometimes called the “old maid’s neurosis, a 
response which imitates the behavior of an innocent person is com¬ 
bined with a sexually aggressive response. The fact that the projector 
attributes similar aggressive behavior to the other person is an addi¬ 
tional detail (Chapter XVII). 

The possibility of identifying oneself with animals or even with 
inanimate objects offers an interesting opportunity to study the 
formal properties of behavior. In what way can a man’s behavior re¬ 
semble the behavior of a cloud or wave or falling tree so that the 
imitative response will summate with other parts of his behavior? 
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MULTIPLE VARIABLES IN PERCEPTION 

It is only a short step to an issue of some importance in the field 
of perception. Our reactions are determined not only by stimuli, but 
by supplementary variables in the fields of emotion, motivation, and 
reinforcement. If we are expecting an important telephone call, we 
may rush to the phone at the faint sound of a doorbell. This is an 
example of stimulus generalization, which can easily be duplicated 
in the rat or pigeon. By increasing the deprivation we increase the 
range of effective stimuli or, to put it another way, reduce the impor¬ 
tance of differences in stimuli. WTien a young man deeply in love 
mistakes a stranger passing in the street for his beloved, the strong 
motivation has made a wider range of stimuli effective in controlling 
the response of seeing his beloved. (We may report that the doorbell 
“sounded like” the telephone, and the lover may insist that the girl 
in the street “looked like” his beloved, just as Dick Whittington 
heard the bells speak rather than himself. What this means we shall 
see later.) 

N’ARIABLES WITH INCOMPATIBLE EFFECTS 

Two responses which use the same parts of the body in different 
ways cannot be emitted together. When two such responses are strong 
at the same time, the condition is often called “conflict.” When the 
incompatible responses are due to different kinds of deprivation, we 
speak of a conflict of motives; when they are due to different reinforc¬ 
ing contingencies, we speak of a conflict of goals; and so on. The 
term suggests an active struggle of some sort inside the organism— 
evidently between some of the hypothetical precursors of behavior. 
The conflict can scarcely be among the independent variables since 
these are physical events, and any conflict would be resolved at the 
physical level. From the present point of view, we must suppose that 
the conflict is between responses and that any “struggle” will be 
evident in the behavior. If we want to study conflict, then, we simply 
strengthen incompatible responses and observe the result. 

Algebraic summation. When incompatible responses resemble 
each other in topography except for sign—when, in other words, they 
are diametrically opposed to each other—the result may be “algebraic 
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summation/’ Simple examples are obsen'cd in the postural reflexes. 
One reflex may call for the extension of a leg. another for its flexion. 
Under certain circumstances the occurrence of both stimuli at the 
same time produces an intermediate position of the leg. A similar 
opposition is possible in the discriminative behavior of the whole 
organism. A dog approaching a strange object, or a soldier going into 
battle, possesses diametrically opposed kinds of behavior—approach 
and withdrawal. If no other variables are to be taken into account, 
the resulting movement will be in one direction or the other but at a 
qualified speed: the individual will move cautiously forward or slowly 
retreat. The combination of variables may, of course, have other 
effects; the behavior may be poorly integrated, less skillfully executed, 
or. as is always the case with behavior of low strength, easily dis¬ 
turbed bv extraneous variables. 

If the resulting movement changes the relative strength of the 
variables, the behavior may oscillate. Thus if the stimulus which 
induces the dog to approach a strange object is stronger than that 
which controls withdrawal, the dog will approach slowly, but if this 
strengthens the variable controlling withdrawal, the direction may at 
some point be reversed. If withdrawal in turn weakens the variables 
controlling withdrawal or strengthens the variables controlling ap¬ 
proach, a second reversal will occur—and so on. The oscillation will 
be slow or rapid depending upon the extent to which the variables 
are modified. The hand of the chess player reaching toward the piece 
to be moved may oscillate either slowly with a period of se\eral sec¬ 
onds or almost as rapidly as in tremor, depending upon the pressure 
of the game. 

The variables responsible for algebraic summation need not be 
stimuli. A man whose "heart is not in his work” exemplifies an oppo¬ 
sition between reinforcing contingencies and variables in the field of 
motivation or emotion. Some of his behavior is due to reinforcement, 
possibly of an economic sort, which keeps him at his job. Opposed 
to this is behavior which is strong for different reasons. We see this 
in the tender-hearted thug, in the idealist caught up in a profession 
in which he must exploit or injure people, or in the pacifist drafted 
into military service. 
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Prepotency. Only rarely will the topography of incompatible re¬ 
sponses permit algebraic summation since in general one response 
cannot simply be subtracted from another. In general, when two 
responses are strong at the same time, only one can be emitted. The 
appearance of one response is called “prepotency.” Tlie term, like 
algebraic summation, is borrowed from the study of simple reflexes, 
but the principle applies to operant behavior as well. We appealed 
to this principle in noting, as an alternative to extinction or punish¬ 
ment. that we may prevent the occurrence of a response simply by 
creating circumstances which evoke an incompatible response which 
is prepotent over it. 

The prepotent response does not, merely by virtue of its having 
been emitted, alter the strength of the dispossessed response. It may, 
however, change some of the variables controlling this response, and 
oscillation may then follow. This is all the more likely because the 
execution of the prepotent response usually weakens it—through 
partial satiation, for example. A simple instance is the selection of a 
necktie. The satiation which follows when a tie is worn is clearly 
evident when it reaches the point at which we are “tired of the tie,” 
but a smaller measure of satiation must be supposed to occur in a 
shorter time. In choosing between two ties, an oscillation may arise 
since putting on one tie increases the relative probability of putting 
on the other. The oscillation mav under certain circumstances be- 
come pathological, as in folie du doute. More important examples 
are frequently dealt with in literary works. An ancient example is the 
conflict between behavior strengthened by “love” and behavior due 
to the ethical pressure which we speak of as “duty” (Chapter XXI). 
The execution of behavior appropriate to either variable changes the 
relative strength of the opposed behavior, which then becomes 
momentarily prepotent. 

The oscillation is rapid if only a slight step in either direction 
makes a significant change in probability, as in the case of the indi¬ 
vidual who “cannot make up his mind” in ordering at a restaurant. 
A very slow oscillation is exemplified by the individual who turns 
from one field of interest to another and back again, perhaps remain¬ 
ing for years in one field. Sometimes a fairly acceptable solution to 
the problem of incompatible behavior is to engage primarily in one 
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type of response but to interlace one’s acti\ity with responses of 
another hpc. This is especially feasible when the latter arc relatively 
independent of the external environment: torn between love and 
duty, one may do one’s duty while continuing to talk about lo\'e. 1 he 
alternative response may also be executed “in fantasy, as we shall 
see in Chapter XV'II. 


To do or not to do. We are often interested in whether a response 
will be emitted in competition with alternati\e behavior which is of 
no importance to us and which we dismiss as doing nothing or as 
“doing something else.” Such behavior (defined merely as incom¬ 
patible with a specified response) appears in the analysis of punish¬ 
ment. Any response which interferes with punished behavior reduces 
a conditioned aversive stimulus and is reinforced for that reason, but 


we may ha\'e little interest in what the response is. 

There arc several kinds of conflict generated by punishment. An 
example of a response wliich is first reinforced and then punished 
is eating a delicious but indigestible food. I'he two consequences fol¬ 
low from the chemical properties of the food, which are positively 
reinforcing on contact with the tongue but eventually aversive in the 
stomach. In eating someone else’s food without his permission, 
aversive consequences may possibly be arranged by the owner of the 
food or by society. The aversive stimulus may precede the positive 
reinforcement—for example, when we swim in cold water for the 
effect of the invigorating glow which follows—but in both cases the 
aversive stimulus is avoided if the response is not emitted. The 
aversive stimulus may follow unless a response is emitted. When an 
individual takes steps to prepare for a bad storm, his behavior reduces 
the threat of strong aversive consequences or "avoids” the conse¬ 
quences of the storm, in the sense of Chapter XI; but a conflict will 
arise if the behavior has its ow-n aversive consequences. 

It is tempting to formulate these cases w'ithout mentioning the 
incompatible behavior. We are interested in whether the indigestible 
food is eaten, or the plunge taken, or the preparation for the storm 
made, not in what may be done instead. This may lead us to speak of 
a negative tendency to engage in the act which is supplanted. One 
variable increases the probability of a response while another appears 
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to reduce it. But for both theoretical and practical purposes it is 
important to remember that we are always dealing with positive prob¬ 
abilities. Punishment, as we have seen, does not create a negative 
probability that a response will be made but rather a positive prob¬ 
ability that incompatible behavior will occur. 

Another example in which it is tempting to speak of negative 
probabilities is "Freudian forgetting.” The instances usually described 
involve punishment. Let us say that an aversive appointment—with 
the dentist, for example—is forgotten. The observed fact is simply 
that the behavior of keeping the appointment does not appear under 
appropriate circumstances. The theory^ of Freudian forgetting asserts 
that the aversive consequences of such appointments are relevant. 
Any step toward keeping the appointment generates conditioned 
aversive stimulation because of earlier painful stimulation in the 
dentist’s chair. Any behavior which reduces the aversive stimulation 
bv displacing such a response is automatically reinforced in accord¬ 
ance with the analysis of Chapter XII. Two mutually exclusive kinds 
of behavior are therefore strong, and the issue is one of prepotency. 
We have no interest, however, in specifying the incompatible re¬ 
sponse. Hence we are likely to suppose that forgetting means that 
the probability of keeping the appointment has reached zero or has 
passed through zero to a negative value. But we need not deal with 
any behavior called “not keeping the appointment.” One response 
has simply lost out to another in the matching of probabilities. If the 
same result were achieved without “forgetting” by canceling the 
appointment, the action which supplanted the behavior would be 
clearly specified, and the principle of prepotency would be obvious. 
Forgetting is ordinarily attributed to an inner organism which “re- 
pres.scs” the behavior of keeping the appointment, but the only 
repressing agent is the incompatible response. 

Just as an additional source of strength may select one response 
from a group of responses otherwise all equally strong, so a sort of 
“negative selection” may arise from the strength of behavior which 
is incompatible with one response in a group. In the example de¬ 
scribed above, the intruding response “speakeasy” could be explained 
in part by its effect in displacing the aversive response “microphone.” 
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When we are eoncemed simply witli wlietlier a single response will 
or will not be emitted, the incompatible behavior may remain un¬ 
specified. I'he basic process, emphasized by Freud, has long been 
recognized. In Barefiester 7’ou’ers, Anthony 1 rollopc described the 
behavior of liis hero Mr. Arabin as follows; 

But he nc\cr could Iui\c loved the Sigiujra Ncroni ns he felt that he 
now loved Flcanor! And so he jhing stones into the brook, instead of 
fhnging himself in, and sat down on its margin as sad a gentleman as you 
shall meet in a summer’s day. 

We cannot account for suicide as a simple response. We cannot, 
for example, measure its frequency. No one jumps into a brook to 
bring his life to an end because the same behavior has had a similar 
consequence in the past. But the general behavior of throwing objects 
into water is another matter. It has a specifiable result; the objects 
disappear. This behavior is readily generalized; having thrown an old 
hat into a brook, we get rid of a pair of shoes in the same way. It is 
not impossible that throwing oneself into a brook may be merely a 
dramatic example of destroying oneself with the behavior which has 
destroyed other things. Fortunately we need not decide this issue to 
make the present point. Both Trollope and Freud agree that Mr. 
Arabin in flinging stones into the brook was to some extent flinging 
himself in. Circumstances had given rise to a strong tendency to 
“throw things into brooks,” but aversive consequences were also 
attached to some responses in this class. Mr. Arabin does not fling 
himself into the brook (or, with less aversive consequences, his watch 
or his pocketbook); he flings stones. Tliis response may have only a 
tenuous membership in the strengthened group, but at least it has 
no aversive consequences and hence is emitted. (The same aversive 
consequences generate the familiar oscillation of the potential suicide, 
as Hamlet demonstrated.) 

In these examples of incompatible behavior, we have considered 
the outcome when nothing interv'enes. Obviously a sudden change in 
circumstances might yield a different result, and, as we shall see in a 
moment, the individual himself may effect such a change. Before 
analyzing how he does so, it is necessary to consider another way in 
which variables may be arranged. 
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CHAINING 

A response may produce or alter some of the variables which con¬ 
trol another response. The result is a "chain.” It may have little or no 
organization. When we go for a walk, roaming the countryside or 
wandering idly through a museum or store, one episode in our be¬ 
havior generates conditions responsible for another. We look to one 
side and are stimulated by an object which causes us to move in its 
direction. In the course of this movement we receive aversive stimu¬ 
lation from which we beat a hasty retreat. This generates a condition 
of satiation or fatigue in which, once free of aversive stimulation, we 
sit down to rest. And so on. Chaining need not be the result of move¬ 
ment in space. We wander or roam verbally, for example, in a casual 
conversation or when we "speak our thoughts” in free association. 

Some chains have a functional unity. The links have occurred in 
more or less the same order, and the whole chain has been affected 
by a single consequence. We often deal with a chain as a single 
"response.” When a cat pounces on a mouse, for example, this com¬ 
plicated act is an intricate network of postural reflexes, as the physi¬ 
ologist Magnus first showed. We often emphasize the initiating 
member (to jump or not to jump), overlooking the fact that it pre¬ 
cedes by several stages the response which is actually reinforced by 
contact with the mouse. Long chains organized as simple sequences 
arc exhibited as we pick our way through streets to a particular spot, 
or recite a poem, or play a piece of music. Other examples have been 
discussed in connection with conditioned reinforcement. Organized 
chains are not necessarily confined to the production of stimuli since 
other sorts of variables may be altered by behavior. In drinking a 
glass of water we change an important condition of deprivation which 
has the usual effect of making further drinking less probable, and 
behavior which has been suppressed by behavior which has led to 
drinking may then be released. A special kind of chaining is repre¬ 
sented by behavior which alters the strength of other behavior and is 
reinforced because it does so. Such behavior could almost be said to 
distinguish the human organism from all others. In Section III we 
shall consider some of the more important problems which it raises. 
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“SELF-CONTROL” 


THE “SELF-DETERMINATION” OF CONDUCT 

Implicit in a functional analysis is the notion of control. 
When we discover an independent variable which can be controlled, 
we discover a means of controlling the behavior which is a function of 
it. This fact is important for theoretical purposes. Proving the validity 
of a functional relation by an actual demonstration of the effect of 
one variable upon another is the heart of experimental science. The 
practice enables us to dispense with many troublesome statistical 
techniques in testing the importance of variables. 

The practical implications are probably even greater. An analysis 
of the techniques through which behavior may be manipulated shows 
the kind of technolog)' which is emerging as the science advances, 
and it points up the considerable degree of control which is currently 
exerted. The problems raised by the control of human behavior ob¬ 
viously can no longer be avoided by refusing to recognize the possi¬ 
bility of control. Later sections of this book will consider these 
practical implications in more detail. In Section IV, for example, in 
an analysis of what is generally called social behavior, we shall see 
how one organism utilizes the basic processes of behavior to control 
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another. The result is particularly impressive when the individual is 
under the concerted control of a group. Our basic processes are re¬ 
sponsible for the procedures through which the ethical group controls 
the behavior of each of its members. An even more effective control 
is exerted by such well-defined agencies as government, religion, psy¬ 
chotherapy, economics, and education; certain key questions concern¬ 
ing such control will be considered in Section V. The general issue of 
control in human affairs will be summarized in Section VI. 

First, however, we must consider the possibility that the indi¬ 
vidual may control his own behavior. A common objection to a pic¬ 
ture of the behaving organism such as we have so far presented runs 
somewhat as follows. In emphasizing the controlling power of ex¬ 
ternal variables, we have left the organism itself in a peculiarly help¬ 
less position. Its behavior appears to be simply a “repertoire”—a 
vocabular)' of action, each item of which becomes more or less prob¬ 
able as the environment changes. It is true that variables may be ar¬ 
ranged in complex patterns; but this fact does not appreciably modify 
the picture, for the emphasis is still upon behavior, not upon the 
behaver. Yet to a considerable extent an individual does appear to 
shape his own destiny. He is often able to do something about the 
variables affecting him. Some degree of “self-determination” of con¬ 
duct is usually recognized in the creative behavior of the artist and 
scientist, in the self-exploratory behavior of the writer, and in the 
self-discipline of the ascetic. Humbler versions of self-determination 
are more familiar. The individual “chooses” between alternative 
courses of action, “thinks through” a problem while isolated from the 
relevant environment, and guards his health or his position in society 
through the exercise of “self-control.” 

Any comprehensive account of human behavior must, of course, 
embrace the facts referred to in statements of this sort. But we can 
achieve this without abandoning our program. When a man controls 
himself, chooses a course of action, thinks out the solution to a 
problem, or strives toward an increase in self-knowledge, he is behav¬ 
ing. He controls himself precisely as he would control the behavior 
of anyone else—through the manipulation of variables of which 
behavior is a function. His behavior in so doing is a proper object of 
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analysis, and eventually it must be accounted for with variables lying 
outside the individual himself. 

It is the purpose of Section III to analyze how the indi\idual acts 
to alter the variables of whicli other parts of his bcliax ior arc func¬ 
tions, to distinguish among the various cases which arise in terms of 
the processes involved, and to account for the behavior wliich 
achieves control just as we account for behavior of any other kind. 
The present chapter concerns the processes involved in self-control, 
taking that term in close to its traditional sense, while Chapter X\^I 
concerns behavior which would traditionallv be described as creative 
thinking. The two sets of techniques arc different because in self- 
control the individual can identifv the behavior to be controlled 
while in creative thinking he cannot. The variables which the indi¬ 
vidual utilizes in manipulating his behavior in this way are not always 
accessible to others, and this has led to great misunderstanding. It 
has often been concluded, for example, that self-discipline and think¬ 
ing take place in a nonphysical inner world and that neither activity 
is properly described as behavior at all. We may simplify the analysis 
by considering examples of self-control and thinking in which the 
individual manipulates external variables, but we shall need to com¬ 
plete the picture by discussing the status of private events in a science 
of behavior (Chapter XVII). A purely private event would have 
no place in a study of behavior, or perhaps in any science; but events 
which are, for the moment at least, accessible only to the individual 
himself often occur as links in chains of other^visc public events and 
they must then be considered. In self-control and creative thinking, 
where the individual is largely engaged in manipulating his own 
behavior, this is likely to be the case. 

When we say that a man controls himself, we must specify who 
is controlling whom. When we say that he knows himself, we must 
also distinguish between the subject and object of the verb. Evidently 
selves are multiple and hence not to be identified with the biological 
organism. But if this is so, what are they? What are their dimensions 
in a science of behavior? To what extent is a self an integrated person¬ 
ality or organism? How can one self act upon another? The inter¬ 
locking systems of responses which account for self-control and 
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thinking make it possible to answer questions of this sort satisfac¬ 
torily, as we shall see in Chapter XVIII. We can do this more con¬ 
veniently, however, when the principal data are at hand. Meanwhile, 
the term “self’' will be used in a less rigorous way. 

"SELP CONTROL ” 

The individual often comes to control part of his own behavior 
when a response has conflicting consequences—when it leads to both 
positive and negative reinforcement. Drinking alcoholic beverages, 
for example, is often followed by a condition of unusual confidence 
in which one is more successful socially and in which one forgets 
responsibilities, anxieties, and other troubles. Since this is positively 
reinforcing, it increases the likelihood that drinking will take place 
on future occasions. But there are other consequences—the physical 
illness of the “hang-over” and the possibly disastrous effects of over¬ 
confident or irresponsible beha\hor—which are negatively reinforcing 
and, when contingent upon behavior, represent a form of punish¬ 
ment. If punishment were simply the reverse of reinforcement, the 
two might combine to produce an intermediate tendency to drink, 
but we have seen that this is not the case. When a similar occasion 
arises, the same or an increased tendency to drink will prevail; but 
the occasion as well as the early stages of drinking will generate con¬ 
ditioned aversive stimuli and emotional responses to them which we 
speak of as shame or guilt. The emotional responses may have some 
deterrent effect in weakening behavior—as by “spoiling the mood.” 
A more important effect, however, is that any behavior which weak¬ 
ens the behavior of drinking is automatically reinforced by the result¬ 
ing reduction in aversive stimulation. We have discussed the behavior 
of simply “doing something else,” which is reinforced because it 
displaces punishable behavior, but there are other possibilities. The 
organism may make the punished response less probable by altering 
the variables of which it is a function. Any behavior which succeeds 
in doing this will automatically be reinforced. We call such behavior 
self-control. 

The positive and negative consequences generate two responses 
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which are related to each other in a special way: one response, tlic 
controUmg responsCy affects variables in such a way as to change the 
probability of the other, the controlled response. The controlling 
response may manipulate any of the variables of whicli the controlled 
response is a function; hence there are a good many different forms 
of self-control. In general it is possible to point to parallels in which 
the same techniques are employed in controlling the behavior of 
others. A fairly exhaustive sur\'ey at this point will illustrate the 
process of self-control and at the same time serse to summarize the 
kind of control to be emphasized in the chapters which follow. 


TECHNIQUES OF CONTROL 

Physical restraint and physical aid. We commonly control behavior 
through physical restraint. With locked doors, fences, and jails, we 
limit the space in which people move. With strait-jackets, gags, and 
arm braces, we limit the movement of parts of their bodies. The indi¬ 
vidual controls his own behavior in the same way. lie claps his hand 
over his mouth to keep himself from laughing or coughing or to stifle 
a verbal response which is seen at the last moment to be a “bad 
break.” A child psychologist has suggested that a mother who wishes 
to keep from nagging her child should seal her own lips with adhe¬ 
sive tape. I’he individual may jam his hands into his pockets to pre¬ 
vent fidgeting or nail-biting or hold his nose to keep from breathing 
when under water. He may present himself at the door of an insti¬ 
tution for incarceration to control his own criminal or psychotic 
behavior. He may cut his right hand off lest it offend him. 

In each of these examples we identify a controlling response, which 
imposes some degree of physical restraint upon a response to be con¬ 
trolled. To explain the existence and strength of the controlling 
behavior we point to the reinforcing circumstances which arise when 
the response has been controlled. Clapping the hand over the mouth 
is reinforced and will occur again under similar circumstances because 
it reduces the aversive stimulation generated by the cough or the 
incipient bad break. In the sense of Chapter XII, the controlling 
response avoids the negatively reinforcing consequences of the con- 
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trolled response. The aversive consequences of a bad break are sup¬ 
plied by a social environment; the aversive consequences of breathing 
under water do not require the mediation of others. 

Another form of control through physical restraint is simply to 
move out of the situation in which the behavior to be controlled may 
take place. The parent avoids trouble by taking an aggressive child 
away from other children, and the adult controls himself in the same 
way. Unable to control his anger, he simply walks away. This may 
not control the whole emotional pattern, but it does restrain those 
features which arc likely to have serious consequences. 

Suicide is another form of self-control. Obviously a man does not 
kill himself because he has previously escaped from an aversive situa¬ 
tion by doing so. As we have already seen, suicide is not a form of 
behavior to which the notion of frequency of response can be applied. 
If it occurs, the components of the behavior must have been strength¬ 
ened separately. Unless this happens under circumstances in which 
frequency is an available datum, we cannot say meaningfully that a 
man is “likely or unlikely to kill himself”—nor can the individual say 
this of himself (Chapter XVII). Some instances of suicide, but by no 
means all, follow the pattern of cutting off one’s right hand that it 
may not offend one; the military agent taken by the enemy may use 
this method to keep himself from divulging secrets of state. 

A variation on this mode of control consists of removing the situa¬ 
tion, so to speak, rather than the individual. A government stops 
inflationary spending by heavy taxation—by removing the money or 
credit which is a condition for the purchase of goods. A man arranges 
to control the behavior of his spendthrift heir by setting up a trust 
fund. Non-coeducational institutions attempt to control certain kinds 
of sexual behavior by making the opposite sex inaccessible. The indi¬ 
vidual may use the same techniques in controlling himself. He may 
leave most of his pocket money at home to avoid spending it, or he 
may drop coins into a piggy bank from which it is difficult to with¬ 
draw them. He may put his own money in trust for himself. H. G. 
Wells’s Mr. Polly used a similar procedure to distribute his funds 
over a walking trip. He would mail all but a pound note to himself at 
a village some distance along his route. Arriving at the village, he 
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would call at the post office, remove a pound note, and readdress the 
balance to himself at a later point. 

In a converse technique we increase the probability of a desirable 
form of behavior by supplying physical aid. We facilitate human 
behavior, make it possible, or expand and amplify its consequences 
with various sorts of equipment, tools, and machines. When the 
problem of self-control is to generate a given response, we alter our 
own behavior in the same way by obtaining favorable equipment, 
making funds readily available, and so on. 

Changing the stimulus. Insofar as the preceding techniques operate 
through physical aid or restraint, they are not based upon a bchav'- 
ioral process. There are associated processes, however, which may be 
analyzed more accurately in terms of stimulation. Aside from making 
a response possible or impossible, we may create or eliminate the 
occasion for it. To do so, we manipulate either an eliciting or a dis¬ 
criminative stimulus. When a drug manufacturer reduces the proba¬ 
bility that a nauseous medicine will be regurgitated by enclosing it in 
tasteless capsules—or by “sugar-coating the pill”—he is simply remov¬ 
ing a stimulus which elicits unwanted responses. The same procedure 
is available in the control of one’s own reflexes. We swallow a medi¬ 
cine quickly and “chase” it with a glass of water to reduce compa¬ 
rable stimuli. 

We remove discriminative stimuli when we turn away from a 
stimulus which induces aversive action. We may forcibly look away 
from a wallpaper design which evokes the compulsive behavior of 
tracing geometrical patterns. We may close doors or draw curtains 
to eliminate distracting stimuli or achieve the same effect by closing 
our eyes or putting our fingers in our ears. We may put a box of 
candy out of sight to avoid overeating. This sort of self-control is 
described as “avoiding temptation,” especially when the aversive con¬ 
sequences have been arranged by society. It is the principle of “Get 
thee behind me, Satan.” 

We also present stimuli because of the responses they elicit or 
make more probable in our own behavior. We rid ourselves of 
poisonous or indigestible food with an emetic—a substance which 
generates stimuli which elicit vomiting. We facilitate stimulation 
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when we wear eyeglasses or hearing aids. \Ve arrange a discriminative 
stimulus to encourage our own behavior at a later date when we tie a 
string on our finger or make an entry in a date book to serve as the 
occasion for action at an appropriate time. Sometimes we present 
stimuli because the resulting behavior displaces behavior to be con¬ 
trolled—we “distract” ourselves just as we distract others from a situ¬ 
ation which generates undesirable behavior. We amplify stimuli 
generated by our own behavior when we use a mirror to acquire good 
carriage or to master a difficult dance step, or study moving pictures 
of our own behavior to improve our skill in a sport, or listen to pho¬ 
nograph recordings of our own speech to improve pronunciation or 
delivery. 

Conditioning and extinction provide other ways of changing the 
effectiveness of stimuli. We arrange for the future effect of a stimulus 
upon ourselves by pairing it with other stimuli, and we extinguish 
reflexes by exposing ourselves to conditioned stimuli when they are 
not accompanied by reinforcement. If we blush, sweat, or exhibit 
some other emotional response under certain circumstances because 
of an unfortunate episode, we may expose ourselves to these circum¬ 
stances under more favorable conditions in order that extinction may 
take place. 

Depriving and satiating. An impecunious person may make the 
most of an invitation to dinner by skipping lunch and thus creating 
a high state of deprivation in which he will eat a great deal. Con¬ 
versely, he may partially satiate himself with a light lunch before 
going to dinner in order to make the strength of his ingestive behav¬ 
ior less conspicuous. When a guest prepares himself for an assiduous 
host by drinking a large amount of water before going to a cocktail 
party, he uses self-satiation as a measure of control. 

Another use is less obvious. In Women in Love, D. H. Lawrence 
describes a practice of self-control as follows: 

A very great doctor . . . told me that to cure oneself of a bad habit, 
one should force oneself to do it, when one would not do it;—make oneself 
do it—and then the habit would disappear. ... If you bite your nails, 
for example, then when you don’t want to bite your nails, bite them, make 
yourself bite them. And you would find the habit was broken. 
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Tin's practice falls within the present class if wc regard the behavior 
of “deliberately” biting one’s finger nails, or biting a piece of cellu¬ 
loid or similar material, as automatically satiating. T he practice obvi¬ 
ously extends bevond what arc usually called “bad habits.” For 
example, if we are unable to work at our desk because of a conflicting 
tendency to go for a walk, a brisk walk may solve the problem- 
through satiation. 

A \ariation on this practice is to satiate one form of behavior by 
engaging in a somewhat similar form. Heavy exercise is often recom¬ 
mended in the control of sexual behavior on the assumption that 
exercise has enough in common with sexual behavior to produce a 
sort of transferred satiation. (T1ie effect is presumed to be due to 
topographical overlap rather than sheer exhaustion.) A similar over¬ 
lap may account for a sort of transferred depriyation. TIic practice of 
leaving the table while still hungr)' has been recommended as a way 
of generating good work habits. Presumably for the same reason the 
vegetarian may be especially alert and higlily efficient because he is, 
in a sense, always hungr)\ Self-deprivation in the field of sex has been 
asserted to have valuable consequences in distantly related fields— 
for example, in encouraging literar\' or artistic achievements. Possibly 
the evidence is weak; if the effect does not occur, we have so much 
the less to explain. 

Manipulating emotional conditions. We induce emotional changes 
in ourselves for purposes of control. Sometimes this means simply 
presenting or removing stimuli. For example, we reduce or eliminate 
unwanted emotional reactions by going away for a “change of scene” 
—that is, by removing stimuli which have acquired the power to 
evoke emotional reactions because of events which have occurred in 
connection with them. We sometimes prevent emotional behavior by 
eliciting incompatible responses with appropriate stimuli, as when 
we bite our tongue to keep from laughing on a solemn occasion. 

We also control the predispositions which must be distinguished 
from emotional responses (Chapter X). A master of ceremonies on 
a television program predisposes his studio audience toward laughter 
before going on the air—possibly by telling jokes which are not per¬ 
missible on the air. Tlie same procedure is available in self-control. 
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We get ourselves into a “good mood” before a dull or trying appoint¬ 
ment to increase the probability that we shall behave in a socially 
acceptable fashion. Before asking the boss for a raise, we screw our 
courage to the sticking place by rehearsing a history of injustice. We 
reread an insulting letter just before answering it in order to generate 
the emotional behavior which will make the answer more easily writ¬ 
ten and more effective. We also engender strong emotional states in 
which undesirable behavior is unlikely or impossible. A case in point 
is the practice described vulgarly as “scaring the hell out of someone.” 
This refers almost literally to a method of controlling strongly pun¬ 
ished behavior bv reinstating stimuli which have accompanied pun¬ 
ishment. We use the same technique when we suppress our own 
behavior by rehearsing past punishments or by repeating proverbs 
which warn of the wages of sin. 

We reduce the extent of an emotional reaction by delaying it—for 
example, by “counting ten” before acting in anger. We get the same 
effect through the process of adaptation, described in Chapter X, 
when we gradually bring ourselves into contact with disturbing stim¬ 
uli. We may learn to handle snakes without fear by beginning with 
dead or drugged snakes of the least disturbing sort and gradually 
moving on to livelier and more frightening kinds. 

Using aversive stimulation. When we set an alarm cloek, we 
arrange for a strongly a^’e^sive stimulus from which we can escape 
only by arousing ourselves. By putting the clock across the room, we 
make certain that the behavior of escape will fully awaken us. We 
condition aversive reactions in ourselves by pairing stimuli in appro¬ 
priate ways—for example, by using the “cures” for the tobacco and 
alcohol habits already described. We also control ourselves by cre¬ 
ating verbal stimuli which have an effect upon us because of past 
aversive consequences paired with them by other people. A simple 
command is an aversive stimulus—a threat—specifying the action 
which will bring escape. In getting out of bed on a cold morning, the 
simple repetition of the command “Get up” may, surprisingly, lead 
to action. The verbal response is easier than getting up and easily 
takes precedence over it, but the reinforcing contingencies estab¬ 
lished by the verbal community may prevail. In a sense the individual 
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“obeys himself.” Continued use of this technique may lead to a finer 
discrimination between commands issued by oneself and by others, 
which may interfere with the result. 

We prepare aversiNC stimuli which will control our own future 
behavior when we make a resolution. 'I'his is essentially a prediction 
conccniing our own bcha\ ior. By making it in the presence of people 
who supply aversive stimulation when a prediction is not fulfilled, we 
arrange consequences which are likely to strengthen the behavior 
resolved upon. Only by behaving as predicted can we escape the 
aversive consequences of breaking our resolution. As we shall see 
later, the aversive stimulation which leads us to keep the resolution 
may eventually be supplied automatically by our own behavior. 'Vhc 
resolution may then be effective even in the absence of other people. 

Dnigs. We use drugs which simulate the effect of other variables 
in self-control. Through the use of anesthetics, analgesics, and sopo¬ 
rifics we reduce painful or distracting stimuli which cannot otherwise 
be altered easily. Appetizers and aphrodisiacs are sometimes used in 
the belief that they duplicate the effects of deprivation in the fields 
of hunger and sex, respectively. Other drugs are used for the opposite 
effects. The conditioned aversive stimuli in “guilt” arc counteracted 
more or less effectively with alcohol. Typical patterns of euphoric 
behavior are generated by morphine and related drugs, and to a lesser 
extent by caffeine and nicotine. 

Operant conditioning. The place of operant reinforcement in self- 
control is not clear. In one sense, all reinforcements are self-adminis¬ 
tered since a response may be regarded as “producing” its reinforce¬ 
ment, but “reinforcing one’s own behavior” is more than this. It is 
also more than simply generating circumstances under which a given 
type of behavior is characteristically reinforced—for example, by asso¬ 
ciating with friends who reinforce only “good” behavior. Tliis is 
simply a chain of responses, an early member of which (associating 
with a particular friend) is strong because it leads to the reinforce¬ 
ment of a later member (the “good” behavior). 

Self-reinforcement of operant beha\'ior presupposes that the indi¬ 
vidual has it in his power to obtain reinforcement but does not do so 
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until a particular response has been emitted. This might be the case 
if a man denied himself all social contacts until he had finished a 
particular job. Something of this sort unquestionably happens, but is 
it operant reinforcement? It is certainly roughly parallel to the pro¬ 
cedure in conditioning the behavior of another person. But it must 
be remembered that the individual may at any moment drop the 
work in hand and obtain the reinforcement. We have to account for 
his not doing so. It may be that such indulgent behavior has been 
punished—say, with disapproval—except w'hen a piece of work has 
just been completed. The indulgent behavior will therefore generate 
strong aversive stimulation except at such a time. The individual 
finishes the work in order to indulge himself free of guilt (Chapter 
XII). The ultimate question is whether the consequence has any 
strengthening effect upon the behavior which precedes it. Is the indi¬ 
vidual more likely to do a similar piece of work in the future? It 
would not be surprising if he were not, although we must agree that 
he has arranged a sequence of events in which certain behavior has 
been followed by a reinforcing event. 

A similar question arises as to whether one can extinguish one’s 
own behavior. Simply emitting a response which is not reinforced is 
not self-control, nor is behavior which simply brings the individual 
into circumstances under which a particular form of behavior will go 
unreinforced. Self-extinction seems to mean that a controlling re¬ 
sponse must arrange the lack of consequence; the individual must 
step in to break the connection between response and reinforcement. 
This appears to be done when, for example, a television set is put out 
of order so that the response of turning the switch is extinguished. 
But the extinction here is trivial; the primary effect is the removal 
of a source of stimulation. 

Punishment. Self-punishment raises the same question. An indi¬ 
vidual may stimulate himself aversively, as in self-flagellation. But 
punishment is not merely aversive stimulation; it is aversive stimula¬ 
tion which is contingent upon a given response. Can the individual 
arrange this contingency? It is not self-punishment simply to engage 
in behavior which is punished, or to seek out circumstances in which 
certain behavior is punished. The individual appears to punish him- 
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self when, liaving recently engaged in a given sort of behavior, he 
injures himself. Behavior of this sort has been said to show a “need 
for punishment.” But we can account for it in another way if in stim¬ 
ulating himself aversively, the individual escapes from an even more 
aversive condition of guilt (Chapter XII). 

There are other variations in the use of aversive self-stimulation. 
A man concerned with reducing his weight may draw his belt up to a 
given notch and allow it to stay there in spite of a strong aversive 
effect. This may directly increase tlie conditioned and unconditioned 
aversiye stimuli generated in the act of overeating and ma) provide 
for an automatic reinforcement for eating with restraint. But we must 
not overlook the fact that a ver)' simple response—loosening the belt 
—will bring escape from the same aversive stimulation. If this behav¬ 
ior is not forthcoming, it is because it has been followed by even 
more aversive consequences arranged by society or by a physician— 
a sense of guilt or a fear of illness or death. The ultimate question of 
aversive self-stimulation is whether a practice of this sort shows the 
effect which would be generated by the same stimulation arranged 
by others. 

“Doing something else.” One technique of self-control which has 
no parallel in the control of others is based upon the principle of 
prepotency. The individual may keep himself from engaging in be¬ 
havior which leads to punishment by energetically engaging in some¬ 
thing else. A simple example is avoiding flinching by a violent re¬ 
sponse of holding still. Holding still is not simply “not-flinching.” 
It is a response which, if executed strongly enough, is prepotent over 
the flinching response. This is close to the control exercised by others 
when they generate incompatible behavior. But where another person 
can do this only by arranging external variables, the individual ap¬ 
pears to generate the behavior, so to speak, simply by executing it. 
A familiar example is talking about something else in order to avoid 
a particular topic. Escape from the aversive stimulation generated by 
the topic appears to be responsible for the strength of the verbal 
behavior which displaces it (Chapter XXIV). 

In the field of emotion a more specific form of “doing something 
else” may be especially effective. Emotions tend to fall into pairs-- 
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fear and anger, lo\'e and hate—according to the direction of the 
behavior which is strengthened. We may modify a man s behavior 
in fear by making him angiy. His behavior is not simply doing some¬ 
thing else; it is in a sense doing the opposite. The result is not pre¬ 
potency but algebraic summation. The effect is exemplihed in self- 
control when we alter an emotional predisposition by practicing the 
opposite emotion—reducing the behavorial pattern in fear by prac¬ 
ticing anger or nonchalance, or avoiding the ravages of hatred by 
“loving our enemies.” 

'HIE ULTIMATE SOURCE OF CONTROL 

A mere survey of the techniques of self-control does not explain 
why the individual puts them into effect. This shortcoming is all too 
apparent when we undertake to engender self-control. It is easy to 
tell an alcoholic that he can keep himself from drinking by throwing 
away available supplies of alcohol; the principal problem is to get 
him to do it. We make this controlling behavior more probable by 
arranging special contingencies of reinforcement. By punishing drink¬ 
ing—perhaps merely with “disapproval”—we arrange for the auto¬ 
matic reinforcement of behavior which controls drinking because 
such behavior then reduces conditioned aversive stimulation. Some 
of these additional consequences are supplied by nature, but in gen¬ 
eral they are arranged by the community. This is indeed the whole 
point of ethical training (Chapter XXI). It appears, therefore, that 
society is responsible for the larger part of the behavior of self-control. 
If this is correct, little ultimate control remains with the individual. 
A man may spend a great deal of time designing his own life—he 
may choose the circumstances in which he is to live with great care, 
and he may manipulate his daily environment on an extensive scale. 
Such activity appears to exemplify a high order of self-determination. 
But it is also behavior, and we account for it in terms of other vari¬ 
ables in the environment and history of the individual. It is these 
variables which provide the ultimate control. 

This view is, of course, in conflict with traditional treatments of 
the subject, which are especially likely to cite self-control as an 
important example of the operation of personal responsibility. But 
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an analysis which appeals to external variables makes tlie assumption 
of an inner originating and determining agent unnecessan. 'The sci- 
entifie advantages of such an analysis arc many, but tlic practical 
advantages may well be even more important. 'The traditional con¬ 
ception of what is happening when an indiv idual controls himself 
has never been successful as an educational device. It is of little help 
to tell a man to use his “will power” or his “self-control.” Such an 
exhortation may make self-control slightly more probable by estab¬ 
lishing additional aversive consequences of failure to control, but it 
does not help anyone to understand the actual processes. An alterna¬ 
tive analysis of the behavior of control should make it possible to 
teach relevant techniques as easily as any other technical repertoire. 
It should also improve the procedures through which society main¬ 
tains self-controlling behavior in strength. As a science of behavior 
reveals more clearly the variables of which behavior is a function, 
these possibilities should be greatly increased. 

It must be remembered that formulae expressed in terms of per¬ 
sonal responsibility underlie many of our present techniques of con¬ 
trol and cannot be abruptly dropped. To arrange a smooth transition 
is in itself a major problem. But the point has been reached where 
a sweeping revision of the concept of responsibility is required, not 
only in a theoretical analysis of behavior, but for its practical conse¬ 
quences as well. We shall return to this point in Sections V and VI. 
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THINKING 


THE BEHAVIOR OF 
MAKING A DECISION 

In self-control the alternative courses of action are specifi¬ 
able in advance, and the issue is resolved before control is exerted. 
The techniques of control can be efficiently designed to achieve a 
particular state of affairs. There are instances of the manipulation of 
one’s own behavior, however, in which the outcome cannot be pre¬ 
dicted. Some sort of “self-determination" is involved, for example, in 
deciding which of two courses of action is to be followed. The task is 
not simply to make a selected course of action probable but to decide 
an issue. The individual sometimes does this by manipulating some 
of the variables of which his behavior is a function. The techniques 
are more limited than in self-control because the outcome cannot 
be specified in advance. 

In making a decision, as in self-control, the manipulated variables 
are often private events within the organism. As such they present a 
special problem, to which we shall return in Chapter XVII. Familiar 
instances in which the variables are accessible to everyone will suffice 
here. The processes appear to be the same whether the variables are 
public or private. “Making a decision" also resembles self-control in 
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that some of the techniques are used in essentially the same way in 
controlling the behavior of others. This is not true when we persuade 
someone to behase in a given wav since our variables operate in 
favor of a single alternative, and no decision is involved. When we 
attempt to help someone “make up his mind” without prejudice to 
any course of action, however, we emplov the techniques vvliich the 
individual may use upon himself in reaching a decision. 

Although variables in the field of motivation and conditioning are 
used in making a decision, they are less specific and their effect is 
often delayed. For more direct results we resort to the manipulation 
of stimuli. If all relevant courses of action show some strength before 
we decide among them, our techniques consist of finding supplemen¬ 
tary sources of strength which, wdien applied to the behavior of 
others, would be classified as prompting or probing {Chapter XIV). 
In deciding whether to spend our v acation in the mountains or at the 
seashore, for example, we may pore over travel magazines and vaca¬ 
tion booklets, find out where our friends are going and what weather 
is predicted for each place, and so on. This material may. if we are 
unluckv, simply maintain the balance between the two courses of 
action, but it is more likely to lead to the prepotent emergence of one 
of them. “Deciding,” as the term will be used here, is not the execu¬ 
tion of the act decided upon but the preliminaiy’ behavior responsible 
for it. 

4’he process of deciding may come to an end before the act is exe¬ 
cuted vv’hen some relatively irrevocable step is taken—for example, 
we may decide about the vacation by making a down payment to 
hold a reserv'ation. A common conclusion is simply to announce our 
decision. By saying that we are going to the seashore, we insure aver¬ 
sive consequences if this prediction of our future behavior is not 
fulfilled. The new variable may prev^ent the reinstatement of any 
conflict and hence of any further behavior of deciding. Deciding is 
also brought to an end when the techniques begin to be applied 
toward a single outcome—when we throw away the pamphlets de¬ 
scribing the seashore and continue to work to strengthen the behav¬ 
ior of going to the mountains. We are then behaving as if w'e had 
been told to go to the mountains for our health and were simply 
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accumulating material which made it possible to carry out the order 
(perhaps in competition with aversive variables which strengthened 
staying home or going elsewhere). 

ORIGIN AND MAINTENANCE OF THE 
BEHAVIOR OF DECIDING 

The individual manipulates relevant variables in making a deci¬ 
sion because the behavior of doing so has certain reinforcing conse¬ 
quences. One of these is simply escape from indecision. Conflicting 
alternatives lead to an oscillation between incomplete forms of re¬ 
sponse which, by occupying a good deal of the individual s time, may 
be strongly aversive. Any behavior which brings this conflict to an 
end will be positively reinforced. What we may distinguish as “due 
deliberation” has other consequences. When we look a situation over 
carefully in the course of making a decision, we presumably increase 
the probability that the response eventually made will achieve maxi¬ 
mal reinforcement. In the long urn the net gain may be enough to 
maintain the strength of the behavior of looking over the situation. 

Escape from indecision or the net advantage of a deliberated re¬ 
sponse may seem inadequate to explain the origin and maintenance 
of the behavior of deciding. They are certainly defective reinforcers, 
for they may be long delayed and their connection with a response 
may be obscure. We may readily admit these deficiencies, however, 
for the behavior of making decisions is also usually deficient. It is not 
present in any degree in the behavior of lower organisms or of many 
people. When present, it is usually the result of special reinforce¬ 
ments applied by the community. Though the individual may acci¬ 
dentally hit upon various ways of deciding, it is more likely that he 
will be taught relevant techniques. We teach a child to “stop and 
think” and to “consider all the consequences” by supplying addi¬ 
tional, and to some extent irrelevant or spurious, reinforcements 
(Chapter XXVI). Even these may not be successful. The child may 
still find it difficult to “make up his mind” and may occasionally ex¬ 
perience the pathological condition of folie du doute or some version 
of the plight of Buridan’s ass. 
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I'UE BEHAX'IOR OF RECALL 

In making a decision the alternative courses of action can be 
specified in advance, even though the outcome cannot be foreseen. 
Are there circumstances under which an individual manipulates vari¬ 
ables to affect a response which he cannot identify until it is emitted? 
At first glance this may seem not only improbable but impossible. 
Nevertheless it is done—and done extensively. Let us suppose that 
we have forgotten the name of a man we must shortly introduce to 
someone. Since the response cannot be specified in advance, the usual 
techniques of self-determination may seem not to apply. I'hcrc is, 
indeed, nothing we can do unless we have a lead of some sort. But 
not being able to identify a response does not mean that wc cannot 
make other statements about it or manipulate conditions relevant 
to it. We may be able to say, for example, that it is a name we once 
knew, that it is a name which will be correct in introducing a par¬ 
ticular person, that we shall probably recognize it at once as correct, 
or that it is the name of a man whom wc met on a particular occa¬ 
sion and with whom we discussed a particular subject. With these 
extra specifications it is not impossible to work upon oneself in order 
to strengthen the response. The available techniques should be classi¬ 
fied as self-probes (Chapter XIV). (A self-prompt would presuppose 
that wc could identify the response.) 

7’he techniques are familiar. We use thematic probes when we 
re\icw a conversation we had with the man in question, when we 
describe the circumstances under which we were introduced to him, 
or when we review thematic classifications (was it a German name, 
an Irish name, an unusual name, and so on?). We use formal probes 
when we try various stress patterns— ta-da-ta-dada —or recite the 
alphabet repetitively in a form of verbal summation. We may even 
set up an aversive condition from which we can escape only by 
emitting the name. This is done in rehearsing a fonnal introduc¬ 
tion—“I’d like to have you meet Mr. . . .’’—or by embarking upon 
the actual introduction, counting upon the powerful pressure which 
will arise when the appropriate point is reached to produce the name. 
If, as the result of any of these procedures, the name “suddenly pops 
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into our head,” then a response has been strengthened which could 
not be specified in advance. 

PROBLEMS AND SOLUTIONS 

In recalling a name it is assumed that the response exists in some 
strength and that other information is available as a source of siip- 
plcmcntar\ stimulation. These are the essential features of a broader 
and generally more complex activity commonly called “problem- 
solving,” “thinking,” or “reasoning.” The analysis of recalling a name 
thus scr\es as a preface to a much more important field of human 
behavior. 

The language in which problem-solving is usually discussed does 
not differ much from the layman’s vocabular>'. The rigorous concepts 
and methods developed in other areas of human behavior are com¬ 
monly abandoned when this field is reached. It is easy to give an 
example of a problem, but it is difficult to define the term rigorously. 
There appears to be no problem for the organism which is not in a 
state of deprivation or aversive stimulation, but something more is 
involved. The hiingr>' organism eating ravenously is perhaps dispos¬ 
ing of a problem, but only in a trivial sense. In the true “problem 
situation” the organism has no behavior immediately available which 
will reduce the deprivation or provide escape from aversive stimula¬ 
tion. This condition may be expressed more generally. We need not 
specify the deprivation or aversive condition if we can demonstrate 
that a response exists in strength which cannot be emitted. Discrimi¬ 
native stimulation may be needed to determine the form or direction 
of the response (the golfer cannot shoot for the green until he finds 
the green); or the response may require external support or instru¬ 
mentation which is lacking (the golfer cannot shoot for the green 
until he finds the ball). We may demonstrate the strength of the 
response in several ways but usually by showing that it occurs as soon 
as the occasion is suitable. 

A locked drawer presents a problem if behavior requiring an open 
drawer is strong and if the individual does not have the key or other 
means of opening it. The strength of the behavior is inferred from 
the presence of responses which have previously opened the drawer 
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or from the appearance of the behavior as soon as the drawer has 
been opened. We can sav tlnit a stalled car presents a problem if no 
behavior wliich succeeds in starting it is immediateh available and 
if behavior whicli has prcvioiislv succeeded in starting it is strong or 
if we ha\ e other evidence that behavior winch depends upon a started 
car is strong. Interlocked wire rings arc a problem if the bcha\ ior of 
demonstrating them apart is strong and no available response makes 
this possible. A murder mystcr)' presents a problem if we arc strongly 
inclined to name the murderer—to show that one name fits all state¬ 
ments in the storv consistently—and cannot do so. Buying wallpaper 
for a room is a problem if we cannot say how many rolls we need; 
it is another tvpc of problem if we have measured the room but 
have not converted our measurements into rolls of paper. Mathemat¬ 
ics is rich in problems, but the motivation of the mathematician is 
often obscure. The deprivation or aversive stimulation responsible for 
the strength of writing a formula which always generates a prime 
number or of proving that a given formula never fails to generate a 
prime number is by no means clear. 

In any case, the solution to a problem is simply a response which 
alters the situation so that the strong response can be emitted. Find¬ 
ing the key to the locked drawer, putting gasoline into the car, 
twisting the wire rings in a certain way, emitting a name which fits 
all the statements in the murder mysteiy, and writing a formula 
which always generates a prime number are solutions in this sense. 
Once the solution has occurred, the problem vanishes simply be¬ 
cause the essential condition has been eliminated. (The same prob¬ 
lem is not likely to recur since the situation will no longer be novel. 
Henceforth, the response which appeared as a solution will occur 
because it has been reinforced under similar circumstances.) 

Simply emitting a solution, however, is not solving a problem. We 
are concerned here with the process of "finding the solution.” Prob¬ 
lem-solving may be defined as any behavior which, through the 
manipulation of variables, makes the appearance of a solution more 
probable. Tliis definition seems to embrace the activities most com¬ 
monly described as problem-solving, and it permits a fairly rigorous 
analysis of procedures or techniques. We may solve the problems of 
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other people in this way, but we shall limit the discussion here to the 
case in which the individual solves his own problems. 

T he appearance of a solution does not guarantee that problem¬ 
solving has taken place. An accidental change in the environment 
often brings about a similar result—the key may be found or the car 
suddenly respond to the starter. A more subtle example, which has 
already been mentioned, is Descartes’s explanation of the behavior 
of the living organism. The problem arose from a strong disposition 
to emit cxplanatorv remarks concerning the operation of the living 
body. We must assume the strength of such behavior even though 
at this late date we cannot account for it. The explanation was a 
metaphor; a response based upon certain fountain figures which were 
constructed to resemble living organisms was simply extended 
through stimulus induction to the living organism itself. We need 
not suppose that at the moment this occurred, Descartes was engaged 
in solving the problem in any active sense. The availability of the 
information about the fountain figures may have been wholly acci¬ 
dental. We need not, therefore, treat any particular part of Des¬ 
cartes’s behavior as problem-solving. It was simply “hitting upon a 
solution.” 

For the same reason, so-called trial-and-error learning is not prob¬ 
lem-solving. The state of deprivation or aversive stimulation required 
by a problem implies the high probability of many responses. Some 
of these may be emitted because the situation resembles other situa¬ 
tions in which they have been reinforced. It is possible that one of 
these will be a solution—that it will solve the problem by disposing 
of the essential condition. But this requires no special treatment. 
Another kind of behavior likely to be observed is random explora¬ 
tion. In the presence of a problem the organism is siipply active. 
Here again the solution may follow by accident. 

An example of problem-solving in the sense of finding a solution 
appears in connection with trial-and-error learning when the organism 
“learns how to try.” It emits responses in great numbers because of 
previous success and perhaps according to certain features of the 
problem. Suppose we challenge an individual to identify a word 
selected from a list. Our challenge provides aversive stimulation, and 
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our statement that we have chosen a word from a particular list pro¬ 
vides a discriminative stimulus increasing the probability of a corre¬ 
sponding set of responses. The individual’s only recourse is to emit 
words on the list until he hits upon the effective response. He may 
have discovered ways of ordering his behavior, however, to avoid 
repetition, to avoid omissions, and so on. He may progress rapidly 
toward a solution if we reinforce him with descriptive categories, lie 
may then run through the alphabet for the initial letter {“Is it a 
word beginning with . . then for the second letter, and so on. 

A formal prompt will soon be generated which will strengthen re¬ 
sponses having a reasonable chance of success. Or he may guess 
thematic or grammatical categories—animal or vegetable, noun or 
verb, and so on. The approach to the solution may be very- skillful 
when profitable categories have once been reinforced. But in spite of 
the fact that one learns to use such a technique and in spite of the 
apparent direction of the process, the behavior is scarcely more than 
a trial-and-error performance. We can account for the emergence of 
each trial response in terms of the current occasion and the past 
histor)^ of the individual. There is a minimum of “self-determination.” 

One way to encourage the emission of a response which may prove 
to be a solution is to manipulate stimuli. A simple example is a sur¬ 
vey of the problem situation. This is often the effect of random 
exploratory behavior and is therefore grouped loosely with trial-and- 
error learning. But the effect is not to emit a response which will 
prove to be a solution but to hit upon stimuli which may control 
such a response. Improving or amplifying available stimulation is 
especially effective; we increase the chances of a solution when we 
look a problem over carefully, when we get all the facts, or when we 
point up relevant stimuli by stating a problem in its clearest terms. 
A further step is to arrange or rearrange stimuli. In the game of 
anagrams, for example, the problem is to compose words from a 
miscellaneous assortment of letters; the solution is simply spelling 
out an acceptable word. It is helpful to rearrange the available letters 
since some arrangements may resemble parts of words in the indi¬ 
vidual’s repertoire and hence ser\'e as formal prompts. The experi¬ 
enced anagram player learns to group letters efficiently, especially in 
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certain subgroups which enable him to make profitable larger groups. 
Me learns to put “q” and “u” together, to try various combinations of 
“si,” “sh,” “sp,” "th,” and so on. 

Tlie logical syllogism is a way of arranging stimuli. The logician 
possesses a verbal repertoire in which certain conclusions are likely 
to be made upon the statement of certain premises, but a particular 
problem may not present itself in the required order. Solving the 
problem consists of arranging the materials in syllogistic form. If the 
solution is obtained wholly by applying a formula {Barbara celar- 
ent . . .), the arrangement does not merely facilitate a response but 
actually determines it, and the process is not problem-solving as here 
defined. But there are less mechanical cases in which the arrange¬ 
ment is made primarily to encourage the appearance of a response 
which has other sources of strength. In the same way the mathemati¬ 
cian is trained to transpose, factor, clear fractions, and so on, until 


an expression appears in a form which suggests a solution. Much of 
this may be relatively mechanical, but in true problem-solving the 
procedures are used to encourage the appearance of a novel response 
which has other sources of strength. 


Scientific knowledge often advances as the result of the arrange¬ 
ment of stimuli. The Linnaean classification of species was an arrange¬ 
ment of data which led, among other results, to Darwin’s solution of 
the problem of the origin of species. Mendelyeev’s table of the ele¬ 


ments was an arrangement of the data of chemistry which necessarily 
preceded modern atomic theor}'. Tlie marshalling of relevant infor¬ 
mation is now so obvious a step in the solution of any problem that 
it is a matter of routine where problems are to be solved by groups 
and where the different functions of problem-solving are delegated to 
different people. The "fact researcher” is a familiar figure in the 
organized problem-solving of science and industry. 

Another technique of problem-solving consists essentially of the 
self-probe. Tentative solutions, perhaps assembled for this purpose, 
are systematically reviewed. There are also certain practices which 
are not to be overlooked even though they are not directed toward 
specific solutions and hence are not ordinarily included in problem¬ 
solving. An example is a certain type of self-probe which is so general 
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that it must be used repetitively in the manner of the verbal sum- 
mator. Repetition is, of course, helpful in increasing the effect of 
more specific techniques, as when we repeatedly surv ey relevant mate¬ 
rial or restate a problem again and again. But something like a formal 
probe which has no specific reference to a given solution appears to 
be exemplified by people who can “think better” in a noisv or other¬ 
wise apparently distracting environment. Features of the noisy back¬ 
ground appear to operate like speech patterns of tlic verbal summator 
to contribute strength to solutions. Visual materials in the form of 
ink blots, “doodlings,” or the ambiguous stimulation of a cnstal ball 
contribute to some kinds of solutions. 

I’hc person who is skilled in “how to think” often manipulates his 
levels of deprivation. He may know how to generate interests relevant 
to a problem, lie may generate an adequate cnergv' level bv arranging 
a satisfactor)' program of sleep or rest. lie may arrange aversive sched¬ 
ules which keep his behavior at an efficient pace. He may follow a 
rigid routine to achieve the same result. Solving a problem mav also 
be facilitated by eliminating responses which conflict with the solu¬ 
tion. The techniques for doing this do not, of course, depend upon a 
particular solution. In recalling a name, for example, a wrong name 
may seem to stand in the way of the right one. Here the response to 
be controlled, the intruding response, can be identified, and any of 
the devices employed in weakening behavior described in Chapter XV 
may be used. 

The “difficulty” of a problem is the availability of the response 
which constitutes the solution. We may not need to increase the 
strength very much. This is the case when the problem closely re¬ 
sembles an earlier one; the wire ring puzzle is like one which has 
previously been solv ed, the murder mysterj' uses a standard plot, and 
the scientific problem parallels a problem in another field. As the 
similarity with earlier instances increases, and with it the availability 
of an adequate response, a point is reached at which it is idle to 
speak of problem-solving at all. At the other extreme there may be 
little or nothing in the present situation which strengthens appro¬ 
priate responses, and in this case the individual must industriously 
manipulate the variables of which his behavior is a function. If no 
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behavior at all is available, no matter what is done by way of chang¬ 
ing the variables, the problem is insoluble so far as he is concerned. 

■ HAVING AN IDEA*’ 

I'he result of solving a problem is the appearance of a solution in 
the form of a response. The response alters the situation so that the 
problem disappears. The relation between the preliminaiy' behavior 
and the appearance of the solution is simply the relation between the 
manipulation of variables and the emission of a response. Until the 
functional relations in behavior had been analyzed, this could not be 
clearly understood; and meanwhile a great many fictional processes 
were invented. Conspicuous examples are the “thought processes" 
called thinking and reasoning. A functional analysis removes much 
of the mystery which surrounds these terms. We need not ask, for 
example, “where a solution comes from." A solution is a response 
which exists in some strength in the repertoire of the individual, if 
the problem is soluble by him. The appearance of the response in 
his behavior is no more surprising than the appearance of any re¬ 
sponse in the behavior of any organism. It is either meaningless or 
idle to ask where the response resides until it summons strength 
enough to spring out into the open. We may also easily represent 
the activities by virtue of which the thinker gets an idea—at least 
so long as the behavior is overt. Special problems undoubtedly arise 
when it is not, but they are not peculiar to the analysis of thinking. 

Instances have been described in which a mathematician abandons 
a problem after working on it for a long time, only to have the solu¬ 
tion “pop into his head” quite unexpectedly at a later date. It is 
tempting to suppose that he has continued to work on the problem 
“unconsciously" and that his solution follows immediately upon 
some successful manipulation of variables. But variables will change 
automatically during a period of time. Variables which have inter¬ 
fered with a solution may grow weak, and supporting variables may 
turn up. We need not, therefore, suppose that any problem-solving 
occurred after overt work on the problem was dropped. The fact that 
the solution comes as a surprise to the individual himself does not 
alter this conclusion. We shall see in Chapter XVIII that genuine 
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problem-solving may well take place when the individual himself can¬ 
not observe it, but many instances of ‘'unconscious thought” can be 
accounted for simplv as changes leading to a solution which ensue 
with the passage of time. 

It is not only in problem-solving that one ‘‘suddenly has an idea” 
in the sense of emitting a response. In a metaphor, for example, we 
have seen that a response is evoked by a stimulus which shares only 
certain tenuous properties with the stimulus originally in control. 
One suddenly “sees the similarity” between repeated misfortune and 
the repeated assault of waves against a rocky coast in the sense that a 
response appropriate to the one is now made to the other. I'his may 
occur with or without external aid. The metaphor may “come to us” 
as we arc speaking or writing, or we may “see the point” when some¬ 
one else emits the transferred response. On a broader scale we “get 
new ideas from a book” in the sense that we acquire many responses 
to a situation which we did not possess before reading it. In this sense 
the book may “clear up our thinking” about a given situation. 

We often manipulate materials in the world about us to generate 
“new ideas” when no well-defined problem is present. A child of six, 
playing with a badminton bird and a white rubber ball, put the ball 
in the feathered end of the bird. This “gave her an idea.” She began 
to lick the ball as if the whole assemblage were an ice cream cone 
and immediately spoke of it as such. There is nothing mysterious 
about this “act of thought.” The manipulative and verbal responses 
appropriate to an ice cream cone were brought out by similar geo¬ 
metrical features of the bird and ball. There was no significant prob¬ 
lem; an idle manipulation of nature simply generated a novel pattern 
which, through stimulus induction, evoked a response characteris¬ 
tically in some strength in a child of six. 

The artist may manipulate a medium simply to generate ideas in 
much the same way. It is true that he may mix or place colors on a 
palette or canvas to solve a specific problem—for example, that of 
producing a likeness. Tlie trained artist has already solved some of 
the subsidiary problems and possesses a repertoire, similar to those 
discussed in Chapter VII, which generates patterns resembling the 
properties of the object to be copied. There may also be certain novel 



254 THE INDIVIDUAL AS A WHOLE 

features in the object which call for the preliminary behavior which 
we should here designate as problem-solving. The artistic exploration 
of a medium may, however, proceed in the absence of any explicit 
problem. This behavior is most obvious when the task is delegated 
to mechanical devices. The artist may generate novel geometrical 
designs by following an arbitrary formula, such as that of “dynamic 
symmetry,” or by “doodling.” In the same way the writer may gen¬ 
erate novel plots by manipulating stock characters in stock situations, 
just as the composer may generate new melodies or rhythms by 
changing the settings on a mechanical device or by manipulating 
symbols on paper or by allowing his cat to walk across the keyboard. 
All this may be done, not to solve a specific problem, but to enlarge 
an artistic repertoire. The general problem is simply to come up with 
something new. 

ORIGINALITY IN IDEAS 

We saw that self-control rests ultimately with the environmental 
variables which generate controlling behavior and, therefore, origi¬ 
nates outside the organism. There is a parallel issue in the field of 
ideas. Is an idea ever original? 

We do not call original that response which is obviously imitative 
or controlled by explicit verbal stimuli, as in following spoken or 
written instructions. We are not wholly inclined to call a response 
original, even though it has never been made before, when it is the 
result of some established procedure of manipulating variables—as in 
routine mathematical operations or the use of syllogistic formulae. 
When a pattern of manipulation has never been applied to a particu¬ 
lar case before, the result is, in a sense, new. For example, the indi¬ 
vidual learns to count as the result of explicit educational reinforce¬ 
ment, but he may be original in what he counts. The observation 
that a cube has six faces must at one time have been an original idea. 

We reserve the term “original” for those ideas which result from 
manipulations of variables which have not followed a rigid formula 
and in which the ideas have other sources of strength. A given 
procedure in problem-solving may never have been used in precisely 
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the same way before or in connection with the same material, and it 
does not lead to the conclusion by itself. Some additional strength is 
supplied by stimulus induction from similar situations. 1 his induc¬ 
tion, however, is also the result of a particular personal history and 
of well-defined behavioral processes. may, therefore, acknowl¬ 

edge the emergence of novel ideas, in the sense of responses never 
made before under the same circumstances, without implying any 
element of originality in the individuals who “have them. 

Man is now in much better control of the world than were his 
ancestors, and this suggests a progress in discovery and invention in 
which there appears to be a strong element of originality. Hut we 
could express this fact just as well by saying that the environment is 
now in better control of man. Reinforcing contingencies shape the 
behavior of the individual, and novel contingencies generate novel 
forms of behavior. Here, if anywhere, originality is to be found. As 
time passes men react to more and more subtle features of the world 
about them and in more and more effective ways. The accumulation 
of behavior is made possible by the growth of a social environment 
which forces modern man to respond to differences which only veiy' 
slowly gained control of the behavior of his ancestors (Chapters XIX 
and XXVIII). Educational agencies established by the group provide 
for the transmission of the results of environmental contingencies 
from one individual to another, and it becomes possible for the indi¬ 
vidual to acquire effective behavior on a vast scale. 

We cannot rigorously account for the origin of important ideas in 
the histor>' of science because many relevant facts have long since 
become unavailable. The question of originality can be disposed of, 
however, by providing plausible accounts of the way in which a given 
idea might have occurred. The study of the histor)' of science has 
made this task somewhat more feasible than it once seemed, since it 
has tended to minimize the contribution made by any one man. It is 
much easier to account for Haney's discovery that the blood passes 
from the right to the left ventricle by way of the lungs and not 
through the septum when we learn that the view had already been 
proposed that some of the blood passed this way. James Watt’s inven¬ 
tion of the steam engine seems much less miraculous when we have 
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once learned about the earlier forms of the engine upon which his 
contribution was based. 

A formulation of creative thinking within the framework of a 
natural science may be offensive to those who prize their conception 
of the individual in control of the world about him (Chapter XXIX), 
but the formulation may have compensating advantages. So long as 
originality is identified with spontaneity or an absence of lawfulness 
in behavior, it appears to be a hopeless task to teach a man to be 
original or to influence his process of thinking in any important way. 
The present analysis should lead to an improvement in educational 
practices. If our account of thinking is essentially correct, there is no 
reason why we cannot teach a man how to think. There is also no 
reason why we cannot greatly improve methods of thinking to utilize 
the full potentialities of the thinking organism—whether this is the 
individual or the organized group or, indeed, the highly complex 
mechanical device. 



CHAPTER XYII 


PRIVATE EVENTS 

IN A NATURAL SCIENCE 


THE WORLD WITHIN ONE’S SKIN 

When we say that behavior is a function of the environ¬ 
ment, the term “environment" presumably means any event in the 
universe capable of affecting the organism. But part of the universe 
is enclosed within the organism s own skin. Some independent vari¬ 
ables may, therefore, be related to behavior in a unique way. The 
individual’s response to an inflamed tooth, for example, is unlike the 
response which anyone else can make to that particular tooth, since 
no one else can establish the same kind of contact with it. Events 
which take place during emotional excitement or in states of depri¬ 
vation are often uniquely accessible for the same reason; in this sense 
our joys, sorrows, loves, and hates are peculiarly our own. With 
respect to each individual, in other words, a small part of the universe 

is private. 

We need not suppose that events which take place within an organ¬ 
ism’s skin have special properties for that reason. A private event may 
be distinguished by its limited accessibility but not, so far as we 
know, by any special structure or nature. We have no reason to sup- 

257 



258 THE INDIVIDUAL AS A WHOLE 

pose that the stimulating effect of an inflamed tooth is essentially 
different from that of, say, a hot stove. The stove, however, is capable 
of affecting more than one person in approximately the same way. 
In studying behavior we may have to deal with the stimulation from 
a tooth as an inference rather than as a directly observable fact. But 
if some of the independent variables of which behavior is a function 
are not directly accessible, what becomes of a functional analysis? 
How are such variables to be treated? 

These questions may not be of interest to all readers. The issue is 
an ancient one, which has occupied the attention of philosophers 
and others for more than two thousand years. It has never been sat¬ 
isfactorily resolved, and perhaps the present inclination on the part 
of educated laymen to avoid it represents simple extinction. For¬ 
tunately, the issue is seldom crucial in the practical control of human 
behavior. The reader whose interests are essentially practical and 
who may now prefer to move on to later chapters may do so without 
serious trouble. Nevertheless, the issue is important and must some¬ 
time be faced. Modern science has attempted to put forth an ordered 
and integrated conception of nature. Some of its most distinguished 
men have concerned themselves with the broad implications of sci¬ 
ence with respect to the structure of the universe. The picture which 
emerges is almost always dualistic. The scientist humbly admits that 
he is describing only half the universe, and he defers to another 
world—a world of mind or consciousness—for which another mode 
of inquiry is assumed to be required. Such a point of view is by no 
means inevitable, but it is part of the cultural heritage from which 
science has emerged. It obviously stands in the way of a unified 
account of nature. The contribution which a science of behavior can 
make in suggesting an alternative point of view is perhaps one of its 
most important achievements. No discussion of the implications of 
science for an understanding of human behavior would be complete 
without at least a brief review of this contribution. 

VERBAL RESPONSES TO PRIVATE EVENTS 

The verbal response “red" is established as a discriminative operant 
by a community which reinforces the response when it is made in the 
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presence of red stimuli and not otherwise. This can easily be done if 
the cominiinitv and the indi\'idual both ha\c access to red stimuli. 
It cannot be done if cither the individual or the coiuniunity is color¬ 
blind. The latter case resembles that in which a verbal response is 
based upon a private e\ent. where, by definition, common access by 
both parties is impossible. How docs the community present or with¬ 
hold reinforcement appropriately in order to bring such a response as 
"My tooth aches” under the control of appropriate stimulation? It 
may easily establish the response "M> tooth is broken" because both 
the individual and the community have access to the stimulus for 
"broken," but the communih' has no comparable access to the stimu¬ 
lus eventually controlling "aches." Nevertheless, verbal behavior of 
this sort is obviously set up. 

The community may resort to public accompaniments of the pri¬ 
vate event. For example, it may establish a verbal response to an 
aching tooth by presenting or withholding reinforcement according 
to a special condition of the tooth which almost certainly accom¬ 
panies the private event or according to violent eollateral responses 
such as holding the jaw or erv ing out. Thus we teach a child to say 
"That itches" or " That tickles" because we obserse either publie 
events which accompany such private stimulation ("the kinds of 
things which itch or tickle”) or some such identihing response as 
scratching or squirming. This method of circumventing the privacy 
of the individual is not foolproof because the public and private 
e\ents may not be perfectly correlated. 

There is another possibility. Verbal responses which are acquired 
with respect to public events may be transferred to private es ents on 
the basis of common properties. It has often been pointed out that 
many subjective terms are metaphorical, at least in origin. The lan¬ 
guage of emotion, for example, is almost wholly metaphorical; its 
terms are borrowed from descriptions of public events in which both 
the individual and the reinforcing community have access to the 
same stimuli. Here again the community cannot guarantee an accu¬ 
rate verbal repertoire because the response may be transferred from 
public event to private event on the basis of irrelevant properties. 

The techniques which guarantee the reliability of a verbal report 
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cannot be brought to bear upon a private description. The science of 
introspective psychology met this difficulty whenever it departed 
from the study of responses to controllable stimuli. The psychologist 
can, for example, manipulate the color, brightness, or saturation of a 
spot of light in order to establish a sensitive verbal repertoire in his 
subject with respect to these properties. Such an experimental situa¬ 
tion docs not raise the problem of privacy at all. But establishing a 
comparable repertoire to distinguish between various states of emo¬ 
tion,” for example, is a task of a very different sort. Unless the psy¬ 
chologist can manipulate the events reported during emotion as he 
manipulates the properties of a patch of light, he must resort to 
imperfect public accompaniments. 

The lavman also finds the lack of a reliable subjective vocabulary 
inconvenient. Eveiy'one mistrusts verbal responses which describe 
private events. Variables are often operating which tend to weaken 
the stimulus control of such descriptions, and the reinforcing com¬ 
munity is usually powerless to prevent the resulting distortion. The 
individual who excuses himself from an unpleasant task by pleading 
a headache cannot be successfully challenged, even though the exist¬ 
ence of the private event is doubtful. There is no effective answer to 
the student who insists, after being corrected, that that was what he 
“meant to say,” but the existence of this private event is not accepted 
with any confidence. 

The individual himself also suffers from these limitations. The 
environment, whether public or private, appears to remain undis¬ 
tinguished until the organism is forced to make a distinction. Anyone 
who has suddenly been required to make fine color discriminations 
will usually agree that he now “sees” colors which he had not pre¬ 
viously “seen.” It is hard to believe that we should not distinguish 
between the primary colors unless there were some reason for doing 
so, but we are conditioned to do this so early in our history that our 
experience is probably not a safe guide. Experiments in which organ¬ 
isms are raised in darkness tend to confirm the view that discrimi¬ 
native behavior waits upon the contingencies which force discrimi¬ 
nations. Now, self-observation is also the product of discriminative 
contingencies, and if a discrimination cannot be forced by the com- 
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miinitv. it mav nc\cr arise. Strangch enougli, it is the coiiinuinity 
which teaches the indisicliial to “know himself.” 


Some contingencies in\ol\ing inner stimulation do not, of course, 
have to be arranged by a reinforcing community. In throwing a ball 
we time a sequence of responses by the stimulation which our own 
movements generate. Here the reinforcing contingencies arc deter¬ 
mined bv the mechanical and geometrical exigencies of throwing a 


ball, and since a reinforcing community is not invoh'cd, the question 
of accessibility to the behaving individual docs not arise. But knowl¬ 
edge,” as we saw in Chapter VIII, is particularly identified with the 
verbal behavior which arises from social reinforcement. Apparently, 


conceptual and abstract behavior arc impossible without such rein¬ 
forcement. The kind of self-knowledge represented by discriminative 


verbal behavior—the knowledge which is “expressed” when we talk 
about our own behavior—is strictly limited by the contingencies 


which the verbal community can arrange. 1‘he deficiencies which 
generate public mistnist lead, in the case of the individual himself, to 
simple ignorance. There appears to be no way in which the individual 
may sharpen the reference of his own verbal repertoire in this respect. 
^^hs is particularly unfortunate because he probably has many rea¬ 
sons for distorting bis own report to himself (Chapter XVIII). 


VARIETIES OF PRIVATE STIMULATION 

It is customary to distinguish between two types of internal stimu¬ 
lation. Interoceptive stimuli arise mainly in the digestive, respiratory', 
and circulatory systems. A full or inflamed stomach, a stomach con¬ 
tracting in hunger, a gallstone distending the bile duct, the contrac¬ 
tions or relaxations of small blood vessels in blushing and blanching, 
and a pounding heart all generate interoceptive stimuli. These are 
the principal stimuli to which one reacts in “feeling an emotion.” 
Proprioceptive stimuli, on the other hand, are generated by the posi¬ 
tion and movement of the body in space and by the position and 
movement of parts of the body with respect to other parts. We usu¬ 
ally respond to stimuli of this sort in combination with exteroceptive 
stimulation from the surrounding environment, and we do not always 
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correctly identify the source of stimulation. Thus when we run our 
hand over a surface and judge it to be sticky, gummy, or slipper)', our 
response is in part to the resistance encountered in moving our hand, 
even though we appear to be talking about the surface as a public 
event. The important point here, however, is not the locus of stimu¬ 
lation but the degree of accessibility to the community. 

An important verbal repertoire describes one’s own behavior. It is 
generated by a community which insists upon answers to such ques¬ 
tions as “What did you say?” “What are you doing?” “What are you 
going to do?” or “Why are you doing that?” Although these ques¬ 
tions are usually practical ones, the theoretical implications are 
equally important. Since the individual may often observe his own 
behavior as a public event, the public-private distinction does not 
always arise. In that case the accuracy of the self-descriptive reper¬ 
toire may be adequate. If a man says, “I went home at three o’clock,” 
there are ways in which this may be checked and his behavior rein¬ 
forced to insure future accuracy. But part of the stimulation which 
the individual receives from his own behavior is different from that 
available to the community. 

A description of behavior which has not been executed appears to 
depend upon private events only. For example, a man may say, “I 
was on the point of going home at three o’clock,” though he did not 
go. 1 Icre the controlling stimuli are not only private, they appear to 
have no public accompaniments. Such responses as “I’m strongly 
inclined to go home” or “I shall go home in half an hour” also de¬ 
scribe states of affairs which appear to be accessible only to the 
speaker. How can the verbal community establish responses of this 
sort? 

A possible explanation is that the terms are established as part of 
a repertoire when the individual is behaving publicly. Private stimuli, 
generated in addition to the public manifestations, then gain the 
necessary degree of control. Later when these private stimuli occur 
alone, the individual may respond to them. “I was on the point of 
going home” may be regarded as the equivalent of “I observed events 
in myself which characteristically precede or accompany my going 
home.” What these events are, such an explanation does not say. 



PRn’^ATE EVENTS IN A NATURAL SCIENCE 263 

Comparable expressions may describe the momentary probability of 

behavior as well as its particular form. 

Another possibility is that when an individual appears to describe 
uncmitted behavior, he is actually describing a histoiy' of variables 
which would enable an independent obsers'er to describe the behavior 
in the same way if a knowledge of the variables were available to him. 
The question, ‘‘Why did you do that?" is often important to the 
community, \s'hich establishes a repertoire of responses based upon 
the external events of which behavior is a function, as well as upon 
the functional relation itself. We are usually able to report that a 
particular stimulating situation, a special contingency of reinforce¬ 
ment. a condition of deprivation, or some emotional circumstance is 
responsible for our own behavior: “I often drop in on X because he 
sers'es excellent drinks,” "I spanked the brat because he had been 
thoroughly anno\ ing,” “I generally take the early train because it is 
less crowded,” and so on. It is possible that the same data may be 
used to predict our own future behavior. The statement, I shall 
probably go abroad next summer,” may be due to variables of a 
wholly public nature which make it equivalent to the statement, 
"Circumstances have arisen which make it highly probable that I 
shall go abroad.” This is not a description of bchavior-to-bc-cmitted 
but of the conditions of which that behavior is a function. The indi¬ 
vidual himself is, of course, often in an advantageous position for 

obseiA'ing his own history. 

One important sort of stimulus to which the individual may pos¬ 
sibly be responding when he describes unemitted behavior has no 
parallel among other forms of private stimulation. It arises from the 
fact that the behavior may actually occur but on such a reduced scale 
that it cannot be obsen ed by others—at least without instrumenta¬ 
tion. This is often expressed by saying that the behavior is “covert.” 
Sometimes it is said that the reduced form is merely the beginning 
of the overt form-that the private event is incipient or inchoate 
behavior. A verbal repertoire which has been established with respect 
to the overt case might be extended to covert behavior because of 
similar self-stimulation. The organism is generating the same effec¬ 
tive stimuli, albeit on a much smaller scale. 
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The appeal to covert or incipient behavior is easily misused. If the 
statement, "I was on the point of going home,” is a response to stim¬ 
uli generated by a covert or incipient response of actually going 
home, how may the response of going home be executed covertly? 
In such a case, one of the other interpretations may well be pre¬ 
ferred. Verbal behavior, however, can occur at the covert level be¬ 
cause it does not require the presence of a particular physical envir¬ 
onment for its execution. Moreover, it may remain effective at the 
covert level because the speaker himself is also a listener and his 
verbal behavior may have private consequences. The covert form 
continues to be reinforced, even though it has been reduced in mag¬ 
nitude to the point at which it has no appreciable effect on the 
environment. Most people obser^^e themselves talking privately. A 
characteristic report begins “I said to myself . . where the stimuli 
which control the response “I said” are presumably similar, except in 
magnitude, to those which in part control the response, ‘T said to 
him . . 

RESPONSES TO ONE'S OWN 
DISCRIMINATIVE BEHAVIOR 

When a man says, “Tliere is a rainbow in the sky” or “The clock 
is striking twelve,” we can give a reasonable interpretation of his 
behavior in terms of a stimulating situation and certain characteris¬ 
tic conditioning procedures with which the community has set up 
verbal responses. But if he says, “I see a rainbow in the sky” or “1 
hear the clock striking twelve,” additional terms have to be taken 
into account. Their importance is easily demonstrated. The group 
usually benefits when an individual responds verbally to events with 
which he alone is in contact. In so doing, he broadens the environ¬ 
ment of those who hear him. But it is also important that he report 
the conditions under which he is responding. In so doing he reveals, 
so to speak, the “source of his information.” The response, “I see a 
rainbow in the sky,” is of a different order of importance from the 
response, "They say there is a rainbow in the sky.” Other reasons why 
the group may be interested in the nature of the behavior of the 
speaker are suggested by such familiar questions as “Do you see that 
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man over bv the window?” “Can you hear me? or Do you smell 
smoke?” 

When the community conditions the individual to say, I sec . . . 

“I hear . . ” “I smell . *and so on, it must have some evidence of 
discriminative behavior. In certain cases it may rely upon the inevi¬ 
tability of a response to a conspicuous stimulus—“You sec, it’s rain¬ 
ing after all.” At other times it may rely upon the orientation of 
receptors: we tell a child that he is seeing a dog when we are sure 
that his eyes are oriented toward the dog. or that he is feeling the 
texture of a piece of cloth when we run his fingers over the cloth. 
But we cannot always or safely count upon evidence that a stimulus 
is merely being received. We liave no comparable evidence for faint 
odors or tastes, or for visual or auditor^' stimuli to which receptors 
need not be especially oriented. How, for example, can the commu¬ 
nity teach the individual to report correctly that he is seeing the 
color of a piece of cloth or hearing the oboe in a full orchestra? Here 
there must be clear evidence that a discriminative reaction is being 
made. “Do you see that bird in the bush?" “Yes.” “What kind is it?” 
Only when collateral information is correctly given does the com¬ 
munity appropriately reinforce the response Yes. 

A verbal repertoire which describes the discriminative behavior of 
the individual appears, then, to be established on external evidence 
that a discriminative response is taking place, rather than that stimuli 
are present or received. When the individual comes to describe his 
own discriminative behavior, presumably be does so, at least initially, 
on comparable evidence. He observes himself as he executes some 
identifying response, lire private events correlated with the public 
events used by the community are also the result of discriminative 
behavior, not simple stimulation. The response, "I see a rainbow,” is, 
therefore, not equivalent to “Tliere is a rainbow. If it were, a single 
discriminative stimulus—the rainbow—would account for both forms, 
but “I see a rainbow” is a description of the response of seeing a rain¬ 
bow. Wlien the rainbow is actually present, the distinction may be 

of little moment. 

But the rainbow is not always present. Perhaps the most difficult 
problem in the analysis of behavior is raised by responses beginning 
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“I see . . “I hear . . and so on, when the customary stimuli are 
lacking. Here an accurate formulation of responses which describe 
one’s own discriminative behavior is essential. We may approach this 
problem by surveying the circumstances under which a man sees 
something.” Presumably these will also be the circumstances under 
which he says, **I see something.” (Parallel cases for I hear . . ., 
"I taste . . need not be explicitly discussed.) No special problem 
is raised when an appropriate stimulus is present. We are also pre¬ 
pared for instances in which the stimulus is not the customaiy' one 
but lias enough in common with it to control the response. The 
process of abstraction also provides examples in which the complete 
stimulus is not available but of which an adequate account may 
nevertheless be given. When there are no stimuli present which 
resemble the usual stimuli, a response beginning “I see . . must 
be explained in terms of conditioning. 7’here are two major possi¬ 
bilities corresponding to the distinction between respondent and 
operant conditioning. 

CONDITIONED SEEING 

A man may see or hear “stimuli which are not present” on the 
pattern of the conditioned reflex: he may see X, not only when X is 
present, but when any stimulus which has frequently accompanied 
X is present. The dinner bell not only makes our mouth water, it 
makes us see food. In the Pavlovian formula we simply substitute 
“seeing food” for “salivating.” Originally both of these responses 
were made to food, but through a process of conditioning they are 
eventually made in response to the bell. When a man reports that the 
dinner bell makes him see food (he is more likely to say that it “re¬ 
minds him of food” or “makes him think of food”), we may suppose 
that he is reporting a response which is similar to the response made 
in the presence of food. It is only an unfortunate tradition, appar¬ 
ently due to the Greeks, which leads us to ask what he is seeing in 
such a case. \Vhen he reports that the bell makes his mouth water, 
we do not feel compelled to ask what he is salivating to. A stimulus 
function has been assumed by a different stimulus, which may con¬ 
trol seeing food as well as salivating. 
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The effect of a conditioned stimulus in evoking the response of 
seeing something helps to explain the character of responses to stim¬ 
uli which arc present but which arc at variance with “what is seen.' 
Conditioned seeing may combine with responses to unconditioned 
stimuli. We see familiar objects more readily and easily than unfa¬ 
miliar objects; the stimuli actually present upon a given occasion 
mav be effective both as conditioned and unconditioned stimuli at 
the same time. In catching only a passing glimpse of a bird, we see 
it distinctly if it is a familiar bird and indistinctly if it is not. The 
fragmentary' stimuli have served to evoke conditioned seeing, which 
combines with the unconditioned seeing of the immediate stimulus. 
A poetic description of the sound of the sea is especially effective if 
one reads it while listening to the sea, for the verbal and nonverbal 
stimuli combine to produce an especially strong response. In a pack 
of playing cards, the shape of a heart or diamond is correlated with 
the color red. While playing cards one is especially likely to see a 
heart or diamond, rather than a spade or club, if one catches a 
glimpse of red. The verbal stimulus “heart" is likely to evoke seeing 
red as well as seeing a heart. It has been shown experimentally that 
if one who is familiar with playing cards is very' briefly shown a heart 
printed in black ink, the heart is sometimes seen as red or as a mix¬ 
ture of red and black, perhaps reported as purple. If the card remains 
in view for a longer time, the current stimulus will completely mask 
the conditioned response of seeing red, but a brief exposure of appro¬ 
priate duration leads to a fusion of conditioned and unconditioned 

responses. 

In more general terms, conditioned seeing explains why one tends 
to see the world according to one s previous history'. Certain prop¬ 
erties of the world are responded to so commonly that laws of per¬ 
ception" have been drawn up to describe the behavior thus condi¬ 
tioned. For example, we generally' see completed circles, squares, and 
other figures. An incomplete figure presented under deficient or 
ambiguous circumstances may evoke seeing a completed figure as a 
conditioned response. For example, a ring with a small segment 
missing when very briefly exposed may be seen as a completed ring. 
Seeing a completed ring would presumably not be inevitable in an 
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individual whose daily life was concerned with handling incompleted 
rings~as might be the case in manufacturing certain types of piston 
rings, for example. Some of the so-called synesthesias are also ex¬ 
amples of a fusion of conditioned and unconditioned seeing. In a 
common example numbers are seen as colored. Something of this 
sort could arise if a child first learned to respond to numbers in a 
book in which geometric form and color were systematically paired. 
The geometric form would then lead to the conditioned response of 
seeing the corresponding color. The spoken stimulus Seven would 
lead to two conditioned responses: seeing the form 7 and seeing 
the associated color. 

All those circumstances under which a mature individual will 
exhibit the response of seeing something may be arranged in a con¬ 
tinuum. At one extreme the momentarj' stimulation is optimal. If, 
for example, the individual is listening to a stormy sea, the sound is 
primarily in control. “Hearing the sea” is not a wholly unconditioned 
response, however, since it depends upon previous experience. If we 
now reduce the momentary stimulation by transporting our indi¬ 
vidual farther and farther from the sea, we increase the role played 
by conditioned stimuli. A faint distant roar is heard “as the sound of 
the sea” only because of a particular history'. Any sound similar to 
that of the sea may have this effect—for example, that of traffic in 
the street. If we now begin to introduce conditioned stimuli of a 
clearly different form—for example, nonauditor)’ stimuli—we may be 
able to show the fusion of two distinct effects. If our subject exam¬ 
ines a picture of heavy surf, current auditory stimuli resembling the 
sound of surf will make the total response of seeing and hearing the 
sea more powerful. At the other extreme of our continuum is the 
purely conditioned response—hearing appropriate sounds in a quiet 
room while observing a painting of the sea. If such an effect occurs, 
it must be due to conditioning, since what is heard is an auditory 
stimulus but what is present is visual. 

There are, of course, great differences in the extent to which indi¬ 
viduals exhibit conditioned seeing, hearing, and so on. Francis Galton 
first surveyed this form of human behavior in the nineteenth cen¬ 
tury. Some of his subjects showed an exceptional ability to see things 
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wliich he described to them, while others found it almost impos¬ 
sible. Some subjects showed special abilities in certain fields only. 
Congenital defects of sensor)' equipment are sometimes responsible 
—as. for example, in the color-blind or tone-deaf. Other individual 
differences may be traced to the histories of the individuals. One 
difference depends upon the extent to which the requisite condi¬ 
tioning has taken place. In a world in which visual stimuli are 
extremely important one would expect many conditioned responses 
of this sort to be set up. It is not surprising to find that the com¬ 
poser is especially likely to be able to "hear music which is not 
present.” while the artist is especially able to “see forms which arc 
not present,” and so on. It is possible, of course, that a man may 
become an artist or musician because of special abilities of this sort, 
but the obvious differences in personal history are almost certainly 
relevant. Another difference depends upon whether the individual is 
able to respond to his conditioned discriminative responses, and this 
in turn depends upon whether the community has forced verbal 
responses to them. A society which breeds introspective people would 
probably have more data of this sort to account for, not because more 
private seeing occurs, but because more of it comes into the public 
domain through self-description. In a group which seldom insists 
upon such behavior, the problem might never arise at all. 

\Vlien an individual reports that he sees an object which is actu¬ 
ally before him, we can distinguish between his response to the object 
and his response to his response. The individual himself makes the 
same distinction. It is usually possible for him to say that there is or 
is not a rainbow present when he reports that he sees one and that 
this is the variable of which his behavior is primarily a function. 
When the stimulus only partially resembles the usual stimulus, the 
subject may report that it “reminds him” of it. When the "stimulus 
seen” is actually lacking but the subject cannot report that fact, we 
say that he is suffering from a hallucination. He sees something and 
reports that he sees something, and from these events alone he may 
assert that something is there. When the current situation is further 
clarified, he may revise this report and conclude that he only 
thought” he saw it. On the other hand he may refuse to make a 
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response to the current situation which is incompatible with his 
conditioned response and may insist that what he sees is “really 
there.” I'here arc certain areas in which a collateral check on the 
presence or absence of an appropriate stimulus is not easily made. 
In such a case, we are much less likely to insist upon the distinction. 
Since we do not ordinarily confirm the presence or absence of bitter 
substances in the mouth, we are not likely to argue that the response, 
"My mouth tastes bitter,” is hallucinatory. 

The practical importance of conditioned seeing. A private event is 
not wholly without practical importance. Stimuli which generate 
conditioned seeing are often reinforcing because they do so, and 
they extend the range of reinforcing stimuli available in the control 
of human behavior. The practical task of generating conditioned 
stimuli of special effectiveness is an important one, as the artist, 
writer, and composer know. If it is possible to reinforce a man with 
the “beauties of nature,” it is usually possible to reinforce him also 
with conditioned stimuli which evoke responses of seeing the beau¬ 
ties of nature. It is the function of the “word picture” to generate 
such conditioned seeing. By fusing conditioned and unconditioned 
seeing the artist makes the observer see the same thing in another 
way. Nostalgic music is effective if it “reminds one of happier days, 
a return to which would also be reinforcing. The extent to which 
this process is used in art varies from period to period but is always 
considerable. It is not to be identified with realism or naturalism 
since the responses appropriate to the effect of pure design are also 
largely dependent upon experience. We shall return later to other 
practical applications of conditioned seeing, hearing, and so on. In 
evaluating the effect of a given culture it is important to note the 
extent to which conditioned responses of this sort are set up and the 
extent to which discriminative responses of self-knowledge are estab¬ 
lished with respect to them. 

OPERANT SEEING 

There are many ways of showing that the discriminative operant 
“seeing X” is strong. One kind of evidence is the strength of precur¬ 
rent behavior which makes seeing X possible. Tliis may be nothing 
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more than the behavior of looking at X, which the individual may 
engage in at every opportunity or for long periods of time. Another 
sort of prccurrcnt behavior is looking for X—looking about in ways 
which in the past have led to seeing X. Suppose we strongly rein¬ 
force a person when he finds a four-leaf clover. Xhe increased strength 
of “seeing a four-leaf clover” will be evident in many ways. The 
person will be more inclined to look at four-leaf clovers than before. 
He will look in places where he has found four-leaf clovers. Stimuli 
which resemble four-leaf clovers will evoke an immediate response. 
Under slightly ambiguous circumstances he will mistakenly reach for 
a three-leaf clover. If our reinforcement is effective enough, he may 
even see four-leaf clovers in ambiguous patterns in textiles, wallpaper, 
and so on. He may also "see four-leaf clovers” when there is no simi¬ 
lar visual stimulation—for example, when his eyes are closed or when 
he is in a dark room. If he has acquired an adequate vocabular)' for 
self-description, he may report this by saying that four-leaf clovers 
“flash into his mind” or that he “is thinking about” four-leaf clovers. 

We frequently obsen^e strong behavior without knowing much 
about the circumstances which account for its strength. Consider, for 
example, a person who is interested in dogs. One characteristic of 
such a person is that the response “seeing dogs” is especially strong. 
He looks at dogs at every opportunity and engages in behavior which 
makes it possible to do so—for example, he visits kennels and dog 
shows. He arranges stimuli which resemble dogs—he hangs pictures 
of dogs on his walls, puts statues of dogs on his desk, and buys books 
containing pictures of dogs. If he is an artist, photographer, or 
sculptor, lie may create similar pictures or statues liimself. But tire 
presence of a dog or of a reasonable facsimile is not essential. Con¬ 
ditioned stimuli which have accompanied dogs-leashes, feeding 
equipment, and so on-easily “remind him of dogs.” Certain verbal 
stimuli-for example, stories or descriptions of dogs-lead him to 
“picture dogs to himself,” and he may obtain or even compose such 
stimuli. The same strength is manifested when he sees dogs while 
looking at ink blots, cloud formations, or other ambiguous patterns, 
or when he mistakes some indistinctly seen object for a dog. The 
behavior of seeing dogs also takes place in the absence of any iden- 
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tifiablc external support. He “thinks about dogs/' daydreams of dogs, 
and perhaps even dreams of dogs at night. 

Unlike conditioned seeing in the respondent pattern, such behav¬ 
ior is not elicited by current stimuli and does not depend upon the 
previous pairing of stimuli. The primar)' controlling variables are 
operant reinforcement and deprivation. When we make a man 
hungiA', we strengthen practical responses which have in the past 
been reinforced with food. W'^e also strengthen artistic or verbal 
responses which produce pictures of food, or generate conditioned 
stimuli which are effective because they have accompanied food— 
tlic individual draws pictures of food or talks about delicious meals 
he has eaten. At the same time we induce him to “think of food," to 
daydream of food, or to dream of food. Similarly, it is characteristic 
of men under strong sexual deprivation, not only that they indulge in 
sexual behavior as soon as an occasion presents itself or concern 
themselves with the production or enjoyment of sexual art or engage 
in sexual self-stimulation, but that they also see sexual objects or 
activities in the absence of relevant stimuli. That all these forms of 
activity are traceable to a common variable is shown by eliminating 
the deprivation, whereupon we eliminate all forms of the behavior. 

A discriminative response which can be made when the appropri¬ 
ate stimulus is absent has certain advantages. It does not require the 
sometimes troublesome precurrent behavior which generates an exter¬ 
nal stimulus, and it can occur when such behavior is impossible— 
as when we daydream of a lost love or an opportunity which is wholly 
out of the question. Also, the private response is not punished by 
society, even though the overt form may be. TTiere are, however, 
certain disadvantages. Such behavior does not alter the state of depri¬ 
vation. The fantasies of the hungry or sexually deprived man do not 
alter the situation in such a way as to reduce the strength of the 
behavior through satiation. We often appeal to a reduction in depri¬ 
vation to account for the effectiveness of a reinforcement, but, as we 
saw in Chapter V, the relation explains only why such stimuli are 
currently reinforcing in a given species. The reinforcing effect is 
carried by private as well as public stimuli. To one who is interested 
in dogs, simply seeing dogs is automatically reinforcing. The hungry 
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or sexually deprived man is reinforced by the appearance or presence 
of relevant objects, as well as by seeing them when they are absent. 
Such reinforcement is not dependent upon an actual reduction m the 
state of deprivation. 

Operant seeing at the private level may be reinforced in other 
ways. The private response may produce discriminative stimuli which 
prove useful in executing further behavior of cither a private or public 
nature. In the following problem, for example, behavior is usually 
facilitated by private seeing. "Think of a cube, all six surfaces of 
which are painted red. Divide the cube into twent\'SC\cn ccjual 
cubes by making two horizontal cuts and two sets of two vertical 
cuts each. How many of the resulting cubes will have three faces 
painted red, how many two, how many one, and how many none? 

It is possible to solve this without seeing the cubes in any sense— 
as by saying to oneself, “A cube has eight corners. A corner is defined 
as the intersection of three faces of the cube. There will therefore be 
eight pieces with three painted faces. . . And so on. But the solu- 
tion is easier if one can actually see the twenty-seven small cubes and 
count those of each kind. This is easiest in the presence of actual 
cubes, of course, and even a sketchy drawing will provide useful sup¬ 
port; but many people solve the problem visually without visual 

stimulation. 

Private problem-solving usually consists of a mixture of discrimi¬ 
native and manipulative responses. In this example one may see the 
larger cube, cut it covertly, separate the smaller cubes covertly, see 
their faces, count them subvocally, and so on. In mental arithmetic 
one multiplies, divides, transposes, and so on, seeing the result in 
each case, until a solution is reached. Presumably much of this covert 
behavior is similar in form to the ov'ert manipulation of pencil and 
paper; the rest is discriminative behavior in the form of seeing num¬ 
bers, letters, signs, and so on, which is similar to the behavior which 
would result from overt manipulation. 

There are gjeat individual differences in the extent to which pri¬ 
vate seeing is used. Few people can equal the performance of one of 
Galton’s correspondents who could multiply by visualizing the appro¬ 
priate section of a slide rule, setting it at the appropriate position, 
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and reading off the answer. As in conditioned seeing, such differences 
may be traced either to differences in the extent to which private 
seeing has been established or to differences in the ability to describe 
the resulting self-stimulation or use it as a basis for further behavior. 

^’hcre are also differences in the kind of private event preferred. 
In solving a chess problem, one may have an idea, in the sense of 
Chapter XVI, in several ways. The solution may come as the overt 
response of moving a piece. It may come in overt verbal form (“Move 
the knight to bishop seven”) or in the same form covertly. It may 
also come as covert nonverbal behavior, although it is admittedly 
hard to determine the dimensions of such a response. We commonly 
say, “I said to myself. ‘Move the knight,’ ” but we have no compa¬ 
rable idiom of the form, “I moved the knight to myself" The solu¬ 
tion mav also come in the form of a discriminative reaction: we may 
suddenly see the knight in its new position. 

Even when covert behavior is mainly verbal, other types of private 
responding frequently occur. Some writers report that they first hear 
sentences, which they then record just as they would record the 
speech of another person. Others execute sentences subvocally in an 
obviously muscular form. There are instances in which, particularly 
in dreams, a writer first reads a poem or story, which he then tran¬ 
scribes. The poet deals primarily in verbal behavior, but he may be a 
“seer” who resorts to words only to describe what he has seen, just as 
he would describe a public event. 

Similar differences arise when there is some measure of external 
stimulation. In the Verbal Summator experiment, for example, some 
subjects, listening to faint speech patterns, hear the phonograph say¬ 
ing something. Others find themselves saying something, in which 
case they may also, of course, “hear” their own verbal behavior. 
There is commonly no parallel in the nonverbal projective tests. In 
the Rorschach Test, the effect of the ink blot is primarily to supple¬ 
ment a visual discriminative response. What is revealed is the strength 
of seeing X, not of saying “X.” The verbal report is usually a response 
to the discriminative visual response. 

The verbal repertoire which describes private events may fail to 
distinguish between these cases. If we ask someone to think of the 
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number seven and he reports that he has done so, he may be report¬ 
ing a discriminative response in which he has seen the form 7 or 
the word “seven,” or some spatial arrangement of seven spots, seven 
subdivisions of a line, and so on. But the same report may describe 
the fact that he has said “seven” to himself or has drawn the form 7 
covertly. In this case the report may also include the fact that he has 
heard himself saying “seven” or has seen the result of the nonverbal 
response. It is possible that more than one, or even all, of these 
activities mav occur when one “thinks of the number sc\'en. T he 
community does not insist upon a distinction among them because a 
distinction is usually of little importance. Usually the variables which 
strengthen the discriminative response of seeing an object are also 
those which strengthen the co\ert or overt responses which produce 
the object. If hearing X is strong, saying X will probably be strong 
also, since saying X is a precurrent response which makes hearing X 
possible. This is obvious but none the less important. It is often 
reinforcing to hear oneself praised. A simple expedient is, therefore, 
to praise oneself. Boasting is, so to speak, reinforced by the praise 
which one hears. Under the same conditions of motivation one may 
also demonstrate a high probability of hearing praise—for example, 
one may simply listen closely when one is being praised, or interpret 
an overheard flattering remark as applying to oneself, or misinter¬ 
pret a neutral remark as praise. 

Private discriminative responses are also reinforced by their effect 
in self-control. With the exception of physical restraint all the vari¬ 
ables which one may manipulate in self-control are available at the 
private level (Chapter XV). One may generate an emotional response 
b}’ recounting an emotional event or by simply seeing or hearing it. 
One may generate an aversive condition through a verbal description 
of punishment or through seeing or hearing the punishment again. 

TRADITIONAL TREATMENT 
OF THE PROBLEM 

W^e account for verbal behavior which describes the discriminative 
response of seeing X in the following way. Such behavior is acquired 
when the organism is not only in the presence of X but actually 
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making a discriminative response to X. A similar discriminative 
response may come to occur in the absence of X as the result of 
respondent or operant conditioning. The verbal response which 
describes the discriminative response is not inevitable, but whenever 
it occurs, the same variables may be assumed to be active. We have 
not altered the inaccessibility of the private event by this treatment, 
but we have succeeded in bringing the behavior which describes the 
event under some sort of functional control. 

This is not, of course, the traditional solution to the problem of 
private seeing. It is usually held that one does not see the physical 
world at all, but only a nonphysical copy of it called “experience.’* 
When the physical organism is in contact with reality, the experi¬ 
enced copy is called a “sensation,” “sense datum,” or “percept”; 
when there is no contact, it is called an “image,” “thought,” or “idea.” 
Sensations, images, and their congeries are characteristically regarded 
as psychic or mental events, occurring in a special world of “con¬ 
sciousness” where, although they occupy no space, they can neverthe¬ 
less often be seen. We cannot now say with any certainty why this 
troublesome distinction was 6rst made, but it may have been an 
attempt to solve certain problems which are worth reviewing. 

There are often many ways in which a single event may stimulate 
an organism. Rain is something we see outside our window or hear on 
the roof or feel against our face. Which form of stimulation is rain? 
It must have been difficult to suppose that any one discriminative 
response could identify a physical event. Hence it may have been 
tempting to say that it identified a transient but unitary sensation or 
perception of the event. Eventually the least equivocal form—stimu¬ 
lation through contact with the skin—became most closely identified 
with reality. A form vaguely seen in a darkened room was not “really 
there” until one could touch it. But this was not a wholly satisfactory 
solution. Stimulation arising from contact may not agree perfectly 
with that arising visually or audibly, and we may not be willing to 
identify one form with reality to the exclusion of the others. There 
still are psychologists, however, who argue for the priority of one form 
of stimulation and, hence, insist upon a distinction beUveen experi¬ 
ence and reality. They are surprised to find that “things are not what 
they seem” and that a room which looks square from a given angle 
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may be found upon tactual or visual exploration to be askew. This 
difficulty offers no particular problem here. It is obvious that a single 
event may stimulate an organism in many ways, depending upon the 
construction of the organism and its capacity to be stimulated by 
different forms of energy. We are much less inclined today to ask 
which form of energ}' is the thing itself or correctly represents it. 

Another problem which the distinction between physical and non¬ 
physical worlds may have been an attempt to solve arises from the 
fact that more than one kind of response may be made to stimulation 


arising from a physical event. Rain is something you may run to 
escape from, catch in your hands to drink, prepare crops to receive, 
or call “rain.” Which response is made to “rain in itself”? The solu¬ 
tion was to construct a passive comprehension of rain, which was 
supposed to have nothing to do with practical responses. So far as 
we are concerned here, the problem is disposed of by recognizing 
that many verbal and nonverbal responses may come under the con¬ 
trol of a given form of stimulation. With the possible exception of 
the abstract verbal response, no behavior need be singled out as 


“knowing rain.” 

The process of abstraction raises another difficulty from which the 
concept of experience may have provided escape. We saw in Chapter 
VIII that the referent or meaning of the response “rain” could not be 
identified by examining a single occasion upon which the response 
was made. Certain properties of a class of stimuli control such a 
response, and they can be revealed only by a systematic investigation 
of many instances. Upon any given occasion, the response appears to 
be relatively free of the exigencies of the physical world and to deal 
with a single dimension abstracted from it. The fact that the process 
of abstraction appears to generate a world composed of general prop¬ 
erties, rather than of particular events, has led, however, to incon¬ 
sistent interpretations. On the one hand the particular event has 
been regarded as immediate experience, while the process of abstrac¬ 
tion has been said to construct a physical world which is never di¬ 
rectly experienced. On the other hand the single occasion has been 
viewed as a momentary unanalyzed contact with reality, while sys¬ 
tematic knowledge of the world has been identified with experience. 

Still another difficult}' which must have encouraged the distinction 
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between two worlds was the inadequacy of early physical science 
How could the individual make contact with a world which lay well 
bevond his skin? It was some comfort to suppose that one never knew 
more than one’s own experience, which could be conceived of as 
existing within one's body. And if one never sees the real world but 
onh- an iniaginal copy of it. then it is not difhcult to account for 
instances in which the something seen is not there in the real world 
at all. Wc have only to assume that experience is independent of 
reality. To say that one sees the sensation of a thing when the thing 
itself is far away appears to solve the problem of the location of what 
is seen. To say that one sees an image of the thing when the thing 
itself is absent appears to solve the problem of the existence of what 
is seen. But the solutions are spurious. One still has to explain how 
the distant thing can generate the sensation or how an image can 
occur when the thing is not present. Modern physical science solved 
the first of these problems by bridging the gap between the distant 
object and the organism. A study of behavior solved the second by 
pointing to variables which lead the organism to see X in the absence 

of X. 

Objections to the traditional view. There is scarcely any need to 
point out the disadvantages of terms which refer to supposed non¬ 
physical events. Even if it were possible to define “sensation” and 
“image” in dimensions acceptable in a natural science, they would 
appear as intervening concepts comparable to “drive,” “habit,” 
“instinct,” and so on, and would be subject to the criticism of such 
concepts presented in Section II. As usual the fictional explanation 
has offered unwarranted consolation in the face of difficult problems. 
By suggesting a t\pe of causal event the practice has discouraged the 
search for useful variables. Contrary to the usual view, the special 
contact between the individual and the events which occur within 
his own body does not provide him with “inside information” about 
the causes of his behavior. Because of his preferred position with 
respect to his own history, he may have special information about 
his readiness to respond, about the relation of his behavior to con¬ 
trolling variables, and about the history of these variables. Although 
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this information is sometimes erroneous and, as we shall see in Chap¬ 
ter XVIII, may even be lacking, it is sometimes useful in a science of 
behavior. But the private e\ent is at best no more than a link in a 
causal chain, and it is usually not even that. We may think before 
we act in the sense that we may behave covertly before we behave 
overtly, but our action is not an “expression’' of the covert response 
or the consequence of it. Xhe two are attributable to the same 

variables. 

A recent book on abnormal behavior contains the sentence, “A 
system of emancipated ideas temporarily seizes control of behavior.” 
The facts are as well described by saying, “A system of responses is 
temporarily prepotent.” In either case we ha\’e still to ask, W hy? 
Even though something which may properly be called an idea pre- 
cedes the behavior in a causal chain, we must go back farther than 
the idea to find the relevant variables. If the individual himself 
reports, "I have had the idea for some time but have only just 
recently acted upon it,” he is describing a covert response which 
preceded the overt Since someone who reports “having an idea” is 
likely to be someone who will execute the overt form, wc may find 
the report of an idea helpful. But the report does not complete a 
functional account. As we saw in Chapter X, to say that a man 
strikes another because he feels angry still leaves the feeling of anger 
unexplained. When we have once identified the relevant variables, 
we find the feeling of anger much less important by way of expla¬ 
nation. Similarly, it has often been argued that the conditioned reflex 
is inadequate because it omits mention of a link traditionally de¬ 
scribed as the “association of ideas.” To report that a man salivates 
when he hears the dinner bell may be to overlook the fact that the 
dinner bell first “makes him think of dinner" and that he then sali¬ 
vates because he thinks of dinner. But there is no evidence that 
thinking of dinner, as that expression has been defined here, is more 
than a collateral effect of the bell and the conditioning process. We 
cannot demonstrate that thinking of dinner will lead to salivation 
regardless of any prior event, since a man will not think of dinner in 
the absence of such an event. 

One is still free, of course, to assume that there are events of a 
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nonphysical nature accessible only to the experiencing organism and 
therefore wholly private. Science does not always follow the principle 
of Occam’s razor, because the simplest explanation is in the long run 
not always the most expedient. But our analysis of verbal behavior 
wliich describes private events is not wholly a matter of taste or pref¬ 
erence. We cannot avoid the responsibility of showing how a private 
event can ever come to be described by the individual or, in the 
same sense, be known to him. Our survey of the ways in which a 
community may impart a subjective vocabulary did not reveal any 
means of setting up a discriminative response to privacy as such. A 
world of experience which is by definition available only to the indi¬ 
vidual, wholly without public accompaniment, could never become 
the discriminative occasion for self-description. 

OTHER PROPOSED SOLUTIONS 

Studying one’s own private world. It is sometimes suggested that 
the psychologist can avoid the problem of privacy by limiting his 
study to his own private share of the universe. It is true that psy¬ 
chologists sometimes use themselves as subjects successfully, but only 
when they manipulate external variables precisely as they would in 
studying the behavior of someone else. The scientist's "observation 
of a private event is a response to that event, or perhaps even a re¬ 
sponse to a response to it. In order to carry out the program of a 
functional analysis, he must have independent information about the 
event. This means he must respond to it in some other way. For a 
similar reason he cannot solve the problem of private events in the 
behavior of others by asking them to describe such events. It has 
often been proposed that an objective psychology may substitute the 
verbal report of a private event for the event itself. But a verbal report 
is a response of the organism; it is part of the behavior which a sci¬ 
ence must analyze. The analysis must include an independent treat¬ 
ment of the events of which the report is a function. The report 
itself is only half the story. 

The physiology of sensation. The solution which follows from a 
functional analysis of behavior is to be distinguished from two others 
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which are currently proposed within the framework of a natural sci¬ 
ence. One of these is closely identified with the study of the physi- 
olog)' of receptors in the nervous system, the other with a logical or 
“operational*' analysis of the data of sensation and perception. Such 
concepts as “sensation” and “image” are designed to carry the pat¬ 
tern of the environment into the organism as far as possible and thus 
to bridge the gap between the knower and the known. The task of 
bringing the world to the surface of the organism is properly within 
the scope of physics. Beyond this point it is within the field of psy¬ 
chophysiology. The modem counterpart of the study of mental events 
in a world of consciousness is the study of the action of receptors 
and of the afferent and central nervous systems. The rainbow in the 
sky or some correlated pattern of energy is brought to the outer sur¬ 
face of the eye, then to the retina, then to the optic tract, and even¬ 
tually to certain parts of the brain—preferably with as little distor¬ 
tion as possible. Tliis makes it more plausible to say that the organism 
directly experiences the principal features of the rainbow. It is even 
tempting to suppose that at some stage (presumably the last) the 
pattern in the brain is the sensation or image. But seeing is a response 
to a stimulus rather than a mere camcra-like registering. In carr>ing 
the pattern of the rainbow into the organism, almost no progress is 
made toward understanding the behavior of seeing the rainbow. It is 
of little moment whether the individual sees the actual rainbow or 
the sensation of a rainbow or some terminal neural pattern in the 
brain. At some point he must see, and this is more than recording a 
similar pattern. Apart from the mode of action of receptors and 
other organs, the physiology of sensation is concerned with the ques¬ 
tion of what is seen. The question may be a spurious one arising 
from an idiom or figure of speech. If we say that the rainbow (either 
as an objective event in the environment or as a corresponding pat¬ 
tern within the organism) is not “what is seen” but simply the com¬ 
monest variable which controls the behavior of seeing, we are much 
less likely to be surprised when the behavior occurs as a function of 

other variables. 

Operational definitions of sensation and image. Another proposed 
solution to the problem of privacy argues that there are public and 
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private events and that the latter have no place in science because 
science requires agreement by the members of a community. Far 
from avoiding the traditional distinction between mind and matter, 
or between experience and reality, this view actually encourages it. 
It assumes that there is, in fact, a subjective world, which it places 
beyond the reach of science. On this assumption the only business 
of a science of sensation is to examine the public events which may 
be studied in lieu of the private. 

The present analysis has a very different consequence. It continues 
to deal with the private event, even if only as an inference. It does 
not substitute the verbal report from which the inference is made for 
the event itself. The verbal report is a response to the private event 
and may be used as a source of information about it. A critical analy¬ 
sis of the validity of this practice is of first importance. But we may 
avoid the dubious conclusion that, so far as science is concerned, the 
verbal report or some other discriminative response is the sensation. 

The private made public. One other way of attacking the problem 
within the framework of a natural science is compatible with the 
present analysis. The line between public and private is not fixed. 
The boundary shifts with every discovery of a technique for making 
private events public. Behavior which is of such small magnitude that 
it is not ordinarily observed may be amplified. Covert verbal behavior 
may be detected in slight movements of the speech apparatus. Deaf- 
mutes who speak with their fingers behave covertly with their fingers, 
and the movements may be suitably amplified. There is no reason 
why covert behavior could not be amplified so that the individual 
himself could make use of the additional information—for example, 
in creative thinking. After all, this is only what the individual does 
when he thinks publicly by scratching notes on paper or by manipu¬ 
lating an artistic medium. The problem of privacy may, therefore, 
eventually be solved by technical advances. But we are still faced 
with events which occur at the private level and which are important 
to the organism without instrumental amplification. How the organ¬ 
ism reacts to these events will remain an important question, even 
though the events may some day be made accessible to everyone. 



XVIII 


THE SELF 


What is meant by the “self” in self-control or self-knowl¬ 
edge? When a man jams his hands into his pockets to keep himself 
from biting his nails, who is controlling whom? When he discovers 
that a sudden mood must be due to a glimpse of an unpleasant 
person, who discovers whose mood to be due to whose visual re¬ 
sponse? Is the self which works to facilitate the recall of a name the 
same as the self which recalls it? Wlien a thinker teases out an idea, 
is it the teaser who also eventually has the idea? 

The self is most commonly used as a hypothetical cause of action. 
So long as external variables go unnoticed or are ignored, their func¬ 
tion is assigned to an originating agent within the organism. If we 
cannot show what is responsible for a man’s behavior, we say that he 
himself is responsible for it. The precursors of physical science once 
followed the same practice, but the wind is no longer blown by 
Aeolus, nor is the rain cast down by Jupiter Pluvius. Perhaps it is 
because the notion of personification is so close to a conception of a 
behaving individual that it has been difficult to dispense with similar 
explanations of behavior. Tire practice resolves our anxiety with 
respect to unexplained phenomena and is perpetuated because it 

does so. 
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Whatever the self may be, it is apparently not identical with the 
physical organism. The organism behaves, while the self initiates or 
directs behavior. Moreover, more than one self is needed to explain 
the behavior of one organism. A mere inconsistency in conduct from 
one moment to the next is perhaps no problem, for a single self could 
dictate different kinds of behavior from time to time. But there ap¬ 
pear to be two selves acting simultaneously and in different ways 
when one self controls another or is aware of the activity of another. 

The same facts are commonly expressed in terms of “personalities. 
Tlie personality, like the self, is said to be responsible for features of 
behavior. For example, delinquent behavior is sometimes attnbuted 
to a psychopathic personality. Personalities may also be multiple. 
Two or more personalities may appear in alternation or concurrently. 
They are often in conflict with each other, and one may or may not 
be aware of what the other is doing. 

Multiple selves or personalities are often said to be systematically 
related to each other. Freud conceived of the ego, superego, and id 
as distinguishable agents within the organism. The id was respon* 
sible for behavior which was ultimately reinforced with food, water, 
sexual contact, and other primary biological reinforcers. It was not 
unlike the selfish, aggressive "Old Adam” of Judeo-Christian the¬ 
ology, preoccupied with the basic deprivations and untouched by 
similar requirements on the parts of others. The superego the 
“conscience” of Judeo-Christian theology—was responsible for the 
behavior which controlled the id. It used techniques of self-control 
acquired from the group. When these were verbal, they constituted 
“the still small voice of conscience.” The superego and the id were 
inevitably opposed to each other, and Freud conceived of them as 
often in violent conflict. He appealed to a third agent—the ego— 
which, besides attempting to reach a compromise between the id and 
the superego, also dealt with the practical exigencies of the environ¬ 
ment. 

We may quarrel with any analysis which appeals to a self or per¬ 
sonality as an inner determiner of action, but the facts which have 
been represented with such devices cannot be ignored. The three 
selves or personalities in the Freudian scheme represent important 
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characteristics of behavior in a social milieu. Multiple personalities 
which are less systematically related to each other serve a similar 
function. A concept of self is not essential in an analysis of behavior, 
but what is the alternative way of treating the data? 

THE SELF AS AN ORGANIZED 
SYSTEM OF RESPONSES 

The best way to dispose of any explanator\- fiction is to examine 
the facts upon which it is based. These usually prove to be, or sug¬ 
gest, variables which are acceptable from the point of view of scien¬ 
tific method. In the present case it appears that a self is simply a 
device for representing a functionally unified system of responses. In 
dealing with the data, we have to explain the functional unity of 
such systems and the various relationships which exist among them. 

The unity of a self. A self may refer to a common mode of action. 
Such expressions as “The scholar is Man Thinking" or He was a 
better talker than plumber" suggest personalities identified with 
topographical subdivisions of behavior. In a single skin we find the 
man of action and the dreamer, the solitarj^ and the social spirit. 

On the other hand, a personality may be tied to a particular type 
of occasion—when a system of responses is organized around a given 
discriminative stimulus. Types of behavior which are effective in 
achieving reinforcement upon occasion A are held together and dis¬ 
tinguished from those effective upon occasion B. Thus one’s per¬ 
sonality in the bosom of one’s family may be quite different from 

that in the presenee of intimate friends. 

Responses which lead to a common reinforcement, regardless of 
the situation, may also comprise a functional system. Here the prin¬ 
cipal variable is deprivation. A motion to adjourn a meeting which 
has run through the lunch hour may show “the hungry man speak¬ 
ing.” One’s personality may be very different before and after a satis- 
f)'ing meal. The libertine is very different from the ascetic who 
achieves his reinforcement from the ethical group, but the two may 

exist side by side in the same organism. 

Emotional variables also establish personalities. Under the proper 
circumstances the timid soul may give way to the aggressive man. 
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Tlie hero may struggle to conceal the coward who inhabits the same 

slciri ^ 

The effects of drugs upon personality are well known. The 

euphoria of the morphine addict represents a special repertoire of 
responses the strength of which is attributable to an obvious variable. 
The alcoholic wakes on the morrow a sadder and wiser man. 

It is easy to overestimate the unity of a group of responses, and 
unfortunately personification encourages us to do so. The concept of 
a self may have an early advantage in representing a relatively coher¬ 
ent response system, but it may lead us to expect consistencies and 
functional integrities which do not exist. The alternative to the use 
of the concept is simply to deal with demonstrated covariations in 

the strength of responses. 

Relations among selves. Organized systems of responses may be 
related to each other in the same way as are single responses and for 
the same reasons (Chapters XIV, XV, XVI). For example, two re¬ 
sponse systems may be incompatible. If the relevant variables are never 
present at the same time, the incompatibility is unimportant. If the 
environment of which behavior is a function is not consistent from 
moment to moment, there is no reason to expect consistency in 
behavior. The pious churchgoer on Sunday may become an aggres¬ 
sive, unscrupulous businessman on Monday. He possesses two re¬ 
sponse systems appropriate to different sets of circumstances, and his 
inconsistency is no greater than that of the environment which takes 
him to church on Sunday and to work on Monday. But the control¬ 
ling variables may come together; during a sermon, the churchgoer 
may be asked to examine his business practices, or the businessman 
may engage in commercial transactions with his clergyman or his 
church. Trouble may then arise. Similarly, if an individual has devel¬ 
oped different repertoires with family and friends, the two personali¬ 
ties come into conflict when he is with both at the same time. Many 
of the dramatic struggles which flood the literature on multiple per¬ 
sonalities can be accounted for in the same way. 

More systematic relations among personalities arise from the con¬ 
trolling relations discussed in Chapters XV and XVI. In self-control, 
for example, the responses to be controlled are organized around certain 
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immediate primary reinforcements. To the extent that competition 
for reinforcement makes this behavior aversive to others—and to this 
extent only—we may refer to an anti social personality, the id or Old 
Adam. On the other hand, the controlling behavior engendered by 
the community consists of a selected group of practices e\'ol\cd in 
the histor)' of a particular culture because of their effect upon anti¬ 
social behavior. To the extent that this behavior works to the advan¬ 
tage of the community—and again to this extent only—we may speak 
of a unitaiy' conscience, social conscience, or superego. These two 
sets of variables account, not only for the membership of each group 
of responses, but for the relation between them which we describe 
when we say that one personality is engaged in controlling the other. 
Other kinds of relations between personalities are evident in the 
processes of making a decision, solving a problem, or creating a work 
of art. 

An important relation between selves is the self-knowledge of Chap¬ 
ter XVII. The behavior which we call knowing is due to a particu¬ 
lar kind of differential reinforcement. In even the most rudimentary 
community such questions as "What did you do? ’ or What are you 
doing?” compel the individual to respond to his own overt behavior. 
Probably no one is completely unselfconscious in this sense. At the 
other extreme an advanced and relatively nonpractical society pro¬ 
duces the highly introspective or introverted individual, whose reper¬ 
toire of self-knowledge extends to his covert behavior—a repertoire 
which in some cultures may be almost nonexistent. An extensive 
development of self-knowledge is common in certain Eastern cul¬ 
tures and is emphasized from time to time in those of the W^est ■ 
for example, in the culte du moi of French literature. An efficient 
repertoire of this sort is sometimes set up in the individual for pur¬ 
poses of therapy. The patient under psychoanalysis may become 
highly skilled in observing his own covert behavior. 

When an occasion arises upon which a report of the organism s 
own behavior, particularly at the covert level, is likely to be rein¬ 
forced, the personality which makes the report is a specialist trained 
by a special set of contingencies. The self which is concerned with 
self-knowing functions concurrently with the behavioral system which 
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it describes. But it is sometimes important to ask whether the selves 
generated by other contingencies "know about each other. The 
literature on multiple personalities raises the question as one of 
"continuity of memory." It is also an important consideration in 
the Freudian scheme: to what extent, for example, is the superego 
aware of the behavior of the id? The contingencies which set up the 
superego as a controlling system involve stimulation from the behav¬ 
ior of the id, but they do not necessarily establish responses of know¬ 
ing about the behavior of the id. It is perhaps even less likely that 
the id will know about the superego. Tire ego can scarcely deal with 
conflicts between the other selves without responding to the behavior 
attributed to them, but this does not mean that the ego possesses a 
repertoire of knowing about such behavior in any other sense. 

THE ABSENCE OF SELF-KNOWLEDGE 

One of the most striking facts about self-knowledge is that it may 

be lacking. Several cases deser\'e comment. 

A man may not know that he has done something. He may have 
behaved in a given way, perhaps energetically, and nevertheless be 
unable to describe what he has done. Examples range all the way 
from the unnoticed verbal slip to extended amnesias in which large 
areas of earlier behavior cannot be described by the individual him¬ 
self. The possibility that the behavior which cannot be described 
may be covert raises an interesting theoretical problem, since the 
existence of such behavior must be inferred, not only by the scien¬ 
tist, but by the individual himself. \Ve have seen that a mathemati¬ 
cian frequently cannot describe the process through which he solves 
a problem. Although he may report the preliminary stages of his 
investigation, his arrangement of materials, and many tentative solu¬ 
tions, he may not be able to describe the self-manipulation which 
presumably preceded the required response which he suddenly emits. 
It is not always necessary to infer that other behavior has actually 
occurred, but under certain circumstances this inference may be 
justified. Since authenticated overt behavior sometimes cannot be 
reported by the individual, we have no reason to question the possi¬ 
bility of a covert parallel. 
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A man may not know that he is doing something. Absent-minded 
conduct, unconscious mannerisms, and mechanically habitual behav¬ 
ior are common examples. More dramatic is automatic writing, in 
which behavior taking place at the moment cannot be described by 
the “rest of the organism.” 

A man may not know that he tends to, or is going to, do some¬ 
thing. He may be unaware of aggressive tendencies, of unusual pre¬ 
dilections, or of the high probability that he will follow a given 
course of action. 

A man may not recognize the variables of which his behavior is a 
function. In the Verbal Summator, for example, the subject often 
supposes himself to be repeating a verbal stimulus when it is easy to 
identify variables lying elsewhere in his environment or histor>' which 
account for the behavior (Chapter XIV). Projective tests are used for 
diagnostic purposes just because they reveal variables which the indi¬ 
vidual himself cannot identif)^ 

These phenomena are often viewed with surprise. How can the 
individual fail to observ^e events which are so conspicuous and so 
important? But perhaps we should be surprised that such events are 
obser\ed as often as they are. We have no reason to expect discrimi¬ 
native behavior of this sort unless it has been generated by suitable 
reinforcement. Self-knowledge is a special repertoire. The crucial thing 
is not whether the behavior which a man fails to report is actually 
obser\'able by him, but whether he has ever been given any reason to 

observe it. 

Self-knowledge may, nevertheless, be lacking where appropriate 
reinforcing circumstances have prevailed. Some instances may be 
dismissed without extended comment. For example, the stimuli sup¬ 
plied by behavior may be weak. One may be “unaware” of a facial 
expression because of the inadequacy of the accompanying self¬ 
stimulation. The subject in an experiment on muscle-reading may 
not be aware of the slight responses which the reader detects and 
uses in getting the subject to “tell” him the location of a hidden 
object. The functional relation between behavior and a relevant 
variable is especially likely to be of subtle physical dimensions. A 
face in the crowd may be clear enough as a stimulus to generate a 
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mood, but the fact that it has done so may sHll not be noted. This 
docs not mean that the stimuli are below threshold, for they may be 
brought into control in other ways. When we point out some part 
of the behavior of an individual, an occasion is established under 
which special reinforcement is accorded a discriminative reaction. 
The fact that the individual then responds to his behavior is what 
we mean by saying that he was “able to do so" in the first place. 

Another case of “not knowing what one is doing' is explained by 
the principle of prepotency. In the heat of battle there may be no 
time to observe one’s behavior, since strong responses conflict with 
the discriminative response. Self-knowledge may also be lacking in 
certain states of satiation and in sleep. One may talk in one s sleep 
or behave in other ways “without knowing it.” Behavior under the 
influence of drugs—for example, alcohol—may also occur with a 
minimum of self-observation. The effect of alcohol in reducing the 
behavior of self-knowledge may be similar to that in reducing the 
response to the conditioned aversive stimuli characteristic of guilt 

or anxiety. 

It has been argued that one cannot describe behavior after the 
fact which one could not have described at the time. This appears 
to explain our inability to recall the events of infancy, since the 
behavior of the infant occurs before a repertoire of self-description 
has been set up and therefore too soon to control such a repertoire. 
The same explanation should apply to behavior unnoticed in the heat 
of battle. However, it is possible that the rearousal of response on 
the pattern of the conditioned reflex may supply the basis for a 
description. In any case it is sometimes impossible to describe earlier 
behavior which could have been described, and perhaps was de¬ 
scribed, at the time it was emitted. An important reason why a 
description may be lacking has still to be considered. 

Repression. We have seen that punishment makes the stimuli 
generated by punished behavior aversive. Any behavior which re¬ 
duces that stimulation is subsequently reinforced automatically. 
Now, among the kinds of behavior most likely to generate condi¬ 
tioned aversive stimuli as the result of punishment is the behavior 
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of observing the punished act or of obscr\ ing the occasion for it or 
any tendency to execute it. As the result of punishment, not only do 
we engage in other beha\'ior to the exclusion of punished forms, we 
engage in other behavior to the exclusion of fenowing about pun¬ 
ished behavior, in the sense of Chapter XVII. This may begin simply 
as ‘*not liking to think about” behavior which has led to aversive 
consequences. It may then pass into the stage of not thinking about 
it and eventually reach the point at which the individual denies 
having behaved in a given way, in the face of proof to the contrary. 

The result is commonly called repression. As we saw in Chapters XT I 
and XIV, the individual may repress behavior simply in the sense of 
engaging in competing forms, but we must now extend the meaning 
of the term to include the repression of knowing about punished 
behavior. This is a much more dramatic result, to which the term 
“repression” is sometimes confined. The same formulation applies, 
however. We do not appeal to any special act of repression but 
rather to competing behavior which becomes extremely powerful 

because it avoids aversive stimulation. 

It is not always knowledge of the form of a response which is re¬ 
pressed, because punishment is not always contingent upon form. 
Aggressive behavior, for example, is not punished in warfare. Imi¬ 
tative behavior is not often punished so long as it is actually under 
the control of similar behavior on the part of others. For example, 
when we emit obscene or blasphemous behavior in testifying to an 
instance of it on the part of someone else, our testimony may not 
be entirely free of conditioned aversive consequences, and we may 
avoid testifying if possible; but the aversive stimulation will be much 
less than that aroused by the same behavior when it is not imitative. 
In experiments with the Verbal Summator a subject will often emit 
aggressive, ungrammatical, obscene, or blasphemous responses so 
long as he remains convinced that he is correctly repeating speech 
patterns on a phonograph record. He has been told to repeat what 
he hears and punishment is not contingent upon the form of his be¬ 
havior under these circumstances, especially if a few objectionable 
samples are first presented clearly. As soon as he is told that there 
are no comparable speech patterns on the record, however, this type 
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of response usually becomes much less frequent. The individual must 
now, so to speak, take the responsibility for the aggression, obscenity, 
and so on. In other words, his behavior is now of a form and under 
a controlling relation upon which punishment is contingent. In such 
a case the subject will often refuse to acknowledge that earlier stimuli 

were not of the form he reported. 

A variation on the repression of a controlling relationship is some¬ 
times called "rationalization." The aversive report of a functional re¬ 
lation may be repressed by reporting a fictitious relationship. Instead 
of "refusing to recognize” the causes of our behavior, we invent ac¬ 
ceptable causes. If an aggressive attack upon a child is due to emo¬ 
tional impulses of revenge, it is usually punished by society; but if it 
is emitted because of supposed consequences in shaping the behavior 
of the child in line with the interests of society, it goes unpunished. 
We may conceal the emotional causes of our aggressive behavior, 
either from ourselves or from others, by arguing that the child ought 
to learn what sort of effect he is having on people. We spank the 
child "for his own good.” In the same way we may delight in carry¬ 
ing bad news to someone we dislike "because the sooner he knows it 
the better.” It is not the aggressive response which is repressed, but 
the response of knowing about the aggressive tendency. The ration¬ 
alization is the repressing response which is successful in avoiding 
the conditioned aversive stimulation generated by punishment. 

SYMBOLS 

In Chapter XIV, we saw that a group of responses strengthened by 
a common variable might not all have the same aversive consequences 
and that as a result of the principle of summation the response with 
the least aversive consequence would emerge. In more general terms, 
we may note that the property of a response which achieves reinforce¬ 
ment need not coincide with the property upon which punishment is 
based. A response may appear, therefore, which achieves reinforce¬ 
ment while avoiding punishment. For example, the visual stimulation 
of a nude figure may be reinforcing because of previous connection 
with powerful sexual reinforcement. But in many societies the be¬ 
havior of looking at such figures is severely punished. Under special 
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circumstances—as, for example, in an art museum—it is possible 
to engage in this behavior and escape punishment. The behavior of 
the artist may show a similar compromise. His art must not be porno¬ 
graphic or too sensual, but while staying within certain limits which 
avoid punishment, it may nevertheless be successfully reinforcing for 
biological reasons. In fantasy the individual makes a similar com¬ 
promise between seeing certain objects or patterns and avoiding 
aversive stimulation: he davdreams in a given area but in such a way 
that he does not generate too much guilt. 

A symbol, as the term was used by Freud in the analysis of dreams 
and art, is any temporal or spatial pattern which is reinforcing be¬ 
cause of similarity to another pattern but escapes punishment because 
of differences. Thus an abstract sculpture is symbolic of the human 
form if it is reinforcing because of resemblances and if the artist 
would, in the absence of punishment, have emphasized the resem¬ 
blances. A musical composition symbolizes sexual behavior if it is 
reinforcing because of a similarity in temporal pattern and if it is 
emitted in place of such behavior because it is different enough to 
escape punishment. 

The principal realm of the symbol is the dream which occurs when 
we are asleep. This is a species of private event which is extremely 
difficult to study and is, therefore, the subject of much conflicting 
discussion. In a dream the individual engages in private discrimina¬ 
tive behavior, in the sense of Chapter XVII. He sees, hears, feels, and 
so on, in the absence of the usual stimuli. Controlling variables may 
sometimes be discovered in the immediate environment or in the 
recent history of the individual. In the perseverative dream, for ex¬ 
ample, one may dream of driving a car if one has been driving for 
many hours. More often, however, the relevant variables are harder to 
identify. The attempt to do so is commonly called the interpretation 
of dreams. Freud could demonstrate certain plausible relations be¬ 
tween dreams and variables in the life of the individual. The present 
analysis is in essential agreement with his interpretation. The indi¬ 
vidual is strongly disposed to engage in behavior which achieves such 
reinforcements as sexual contact or the infliction of damage upon 
others. These kinds of behavior, however, are precisely the sort most 
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likelv to be piinisbecl. As a result the individual not only does not 
overtly engage in such behavior, he cannot engage in it covertly or 
see himself engaging in it covertly without automatic aversive self¬ 
stimulation. In the symbolic dream and in artistic or literary behavior, 
however, he may engage in discriminative behavior which is strengt - 
encd through stimulus- or response-induction by the same variables 
but whieh is not liable to punishment. It is often said or implied that 
some skillful agent engages in a sort of “dream-work” to produce this 
result but the result follows automatically from the discrepancy 
between the properties of behavior upon which reinforcement and 

punishment are contingent. 


I 




THE BEHAVIOR OF 

PEOPLE IN GROUPS 




SOCIAL BEHAVIOR 


Social behavior may be defined as the behavior of two or 
more people with respect to one another or in concert with respect 
to a common environment. It is often argued that tins is different 
from individual behavior and that there are “social situations and 
“social forces” which cannot be described in the language of natural 
science. A special discipline called “social science” is said to he re¬ 
quired because of this apparent break in the continuity of nature. 
There are, of course, many facts-concerning governments, wars, 
migrations, economic conditions, cultural practices, and so on-which 
would never present themselves for study if people did not gather 
together and behave in groups, but whether the basic data are fun¬ 
damentally different is still a question. We are interested here in the 
methods of the natural sciences as we see them at work in physics, 
chemistry, and biology, and as we have so far applied them in the 
field of behavior. How far will they carry us m the study of the be- 

havior of groups? , ^ r i. 

Many generalizations at the level of the group need not refer to 

behavior at all. There is an old law in economics, called Greshani s 
Law, which states that bad money drives good money out of circu a- 
tion. If we can agree as to what money is, whether it is good or bad. 



298 THE BEHAVIOR OF PEOPLE IN GROUPS 

and when it is in circulation, we can express this general principle 
without making specific reference to the use of money by individuals. 
Similar generalizations are found in sociology’, cultural anthropology, 
linguistics, and history. But a “social law” must be generated by the 
behavior of individuals. It is always an individual who behaves, and 
he behaves with the same body and according to the same processes 
as in a nonsocial situation. If an individual possessing two pieces of 
money, one good and one bad, tends to spend the bad and save the 

good_a tendency which may be explained in terms of reinforcing 

contingencies-and if this is'true of a large number of people, the 
phenomenon described by Gresham s Law arises. The individual 
behavior explains the group phenomenon. Many economists feel the 
need for some such explanation of all economic law, although there 
arc others who would accept the higher level of description as valid 

in its own right. 

W^e arc concerned here simply with the extent to which an analysis 
of the behavior of the individual which has received substantial vali¬ 
dation under the favorable conditions of a natural science may con¬ 
tribute to the understanding of social phenomena. To apply our 
analysis to the phenomena of the group is an excellent way to test its 
adequacy, and if we are able to account for the behavior of people in 
groups without using any new term or presupposing any new process 
or principle, we shall have revealed a promising simplicity in the data. 
This does not mean that the social sciences will then inevitably state 
their generalizations in terms of individual behavior, since another 
level of description may also be valid and may well be more con¬ 
venient. 

THE SOCIAL EN\HRONMENT 

Social behavior arises because one organism is important to another 
as part of its environment. A first step, therefore, is an analysis of the 
social environment and of any special features it may possess. 

Social reinforcement. Many reinforcements require the presence of 
other people. In some of these, as in certain forms of sexual and pugi¬ 
listic behavior, the other person participates merely as an object. We 
cannot describe the reinforcement without referring to another 
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organism. But social reinforcement is usually a matter of personal 
mediation. When a mother feeds her child, the food, as a primary 
reinforcer, is not social, but the mother’s behavior in presenting it is. 
The difference is slight—as one may see by comparing breast-feeding 
with bottle-feeding. Verbal behavior always involves social reinforce¬ 
ment and derives its characteristic properties from this fact. The 
response, “A glass of water, please,” has no effect upon the mechanical 
environment, but in an appropriate verbal environment it may lead 
to primaiy reinforcement. In the field of social behavior special em¬ 
phasis is laid upon reinforcement with attention, approval, affection, 
and submission. These important generalized reinforcers are social 
because the process of generalization usually requires the mediation 
of another organism. Negative reinforcement—particularly as a fonn 
of punishment—is most often administered by others in the form of 
unconditioned aversive stimulation or of disapproval, contempt, ridi¬ 
cule, insult, and so on. 

Behavior reinforced through the mediation of other people will 
differ in many ways from behavior reinforced by the mechanical en¬ 
vironment. Social reinforcement varies from moment to moment, 
depending upon the condition of the reinforcing agent. Different 
responses may therefore achieve the same effect, and one response may 
achieve different effects, depending upon the occasion. As a result, 
social behavior is more extensive than comparable behavior in a non¬ 
social env'ironment. It is also more flexible, in the sense that the 
organism may shift more readily from one response to another when 

its behavior is not effective. 

Since the reinforcing organism often may not respond appropri¬ 
ately, reinforcement is likely to be intermittent. The result will depend 
upon the schedule. An occasional success may fit the pattern of 
variable interval reinforcement, and the behavior will show a stable 
intermediate strength. We might express this by saying that we re¬ 
spond to people with less confidence than we respond to the inani¬ 
mate environment but are not so quickly convinced that the rein¬ 
forcing mechanism is “out of order.” ITe persistent behavior which 
we call teasing is generated by a variable-Tatio schedule, which arises 
from the fact that the reinforcer responds only when a request has 
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been repeated until it becomes aversive—when it acquires nuisance 
value. 

The contingency established by a social reinforcing system may 
slowly change. In teasing, for example, the mean ratio of unrein- 
forccd to reinforced responses may rise. The child who has gained 
attention with three requests on the average may later find it neces- 
saiy' to make five, then seven, and so on. The change corresponds to 
an increasing tolerance for aversive stimulation in the reinforcing 
person. Contingencies of positive reinforcement may also drift in 
the same direction. When a reinforcing person becomes harder and 
harder to please, the reinforcement is made contingent upon more 
extensive or highly differentiated behavior. By beginning with reason¬ 
able specifications and gradually increasing the requirements, very 
demanding contingencies may be made effective which would be 
quite powerless without this history. The result is often a sort of 
human bondage. The process is easily demonstrated in animal ex¬ 
perimentation where extremely energetic, persistent, or complicated 
responses which would otherwise be quite impossible may be estab¬ 
lished through a gradual change in contingencies. A special case arises 
in the use of piecework pay. As production increases, and with it the 
wages received, the piecework scale may be changed so that more 
work is required per unit of reinforcement. The eventual result may 
be a much higher rate of production at only a slight increase in pay— 
a condition of reinforcement which could not have become effective 
except through some such gradual approach. 

We have already noted another peculiarity of social reinforcement: 
the reinforcing system is seldom independent of the behavior rein¬ 
forced. This is exemplified by the indulgent but ambitious parent 
who withholds reinforcement when his child is behaving energetic¬ 
ally, either to demonstrate the child’s ability or to make the most 
efficient use of available reinforcers, but who reinforces an early 
response when the child begins to show extinction. This is a sort of 
combined ratio-and-interval reinforcement. Educational reinforce¬ 
ments are in general of this sort. They are basically governed by ratio 
schedules, but they are not unaffected by the level of the behavior 
reinforced. As in piecework pay, more and more may be demanded 



SOCIAL BEHAVIOR 301 

for each reinforcement as performance improves, but remedial steps 
may be needed. 

Schedules of reinforcement which adjust to the rate of the be¬ 
havior reinforced do not often occur in inorganic nature. The rein¬ 
forcing agent which modifies the contingency in terms of the be¬ 
havior must be sensitive and complex. But a reinforcing system which 
is affected in this way may contain inherent defects which lead to 
unstable behavior. I’his may explain why the reinforcing contin¬ 
gencies of society cause undesirable behavior more often than those 
apparently comparable contingencies in inanimate nature. 

The social stimulus. Another person is often an important source 
of stimulation. Since some properties of such stimuli appear to 
defy physical description, it has been tempting to assume that a 
special process of intuition or empathy is involved when wc react to 
them. What, for example, are the physical dimensions of a smile? 
In everyday life we identify smiles with considerable accuracy and 
speed, but the scientist would find it a difficult task. He would ha\e 
to select some identifying response in the individual under investiga¬ 
tion—perhaps the verbal response, "That is a smile —and then in¬ 
vestigate all the facial expressions which evoked it. These expressions 
would be physical patterns and presumably susceptible to geometric 
analysis, but'the number of different patterns to be tested would be 
very great. Moreover, there would be borderline instances where the 
stimulus control was defective or varied from moment to moment. 

That the final identification of the stimulus pattern called a smile 
would be much more complicated and time-consuming than the 
identification of a smile in daily life does not mean that scientific 
obser^'ation neglects some important approach available to the lay¬ 
man. The difference is that the scientist must identify a stimulus 
with respect to the behavior of someone else. He cannot trust his 
own personal reaction. In studying an objective pattern as simple 
and as common to everyone as ‘ triangle, the scientist may sa e) 
use his own identification of the pattern. But such a pattern as 
"smile” is another matter. A social stimulus, like any other stimulus, 
becomes important in controlling behavior because of the contm- 
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gcncies into which it enters. The facial expressions which we group 
together and call "smiles” are important because they are the occa¬ 
sions upon which certain kinds of social behavior receive certain 
kinds of reinforcement. Any unity in the stimulus class follows from 
these contingencies. But these are determined by the culture and by a 
particular histor)-. Even in the behavior of a single individual there 
may be several groups of patterns all of wliich come to be called 
smiles if they all stand in the same relation to reinforcing contin¬ 
gencies. The scientist may appeal to his own cultvire or histor\' only 
when it resembles that of the subject he is studying. Even then he 
may be wrong, just as the layman’s quick practical reaction may be 
wrong, especially w'hcn he attempts to identify a smile in a different 
culture. 

This issue is far reaching because it applies to many descriptive 
terms, such as “friendly” and “aggressive,” without which many stu¬ 
dents of social behavior would feel lost. The nonscientist working 
within his own culture may satisfactorily describe the behavior of 
others w'ith expressions of this sort. Certain patterns of behavior 
have become important to him because of the reinforcements based 
upon them: he judges behavior to be friendly or unfriendly by its 
social consequences. But his frequent success does not mean that 
there are objective aspects of behavior which are as independent of 
the behavior of the obscr\’cr as are such geometrical forms as squares, 
circles, and triangles. He is observing an objective event—the behav¬ 
ior of an organism; there is no question here of physical status, but 
only of the significance of classificatory terms. The geometrical prop¬ 
erties of “friendliness” or “aggressiveness” depend upon the culture, 
change with the culture, and vary with the individual’s experience 
within a single culture. 

Some social stimuli are also frequently set apart because a very 
slight physical event appears to have an extremely powerful effect. 
But this is true of many nonsocial stimuli as well; to one who has 
been injured in a fire a faint smell of smoke may be a stimulus of 
tremendous power. Social stimuli are important because the social 
reinforcers with which they are correlated are important. An example 
of the surprising pow'er of an apparently trivial event is the common 
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experience of “catching someone’s eye.” Under certain circumstances 
the change in behavior which follows may be considerable, and this 
has led to the belief that some nonphysical “understanding” passes 
from one person to another. But the reinforcing contingencies offer 
an alternative explanation. Our behavior may be veiy' different in the 
presence or absence of a particular person. When we simply see such 
a person in a crowd, our available repertoire immediately changes. If, 
in addition, we catch his eye, we fall under the control of an even 
more restrictive stimulus—he is not only present, he is watching us. 
The same effect might arise without catching his eye if wc saw him 
looking at us in a mirror. When we catch his eye, we also know that 
he knows that we are looking at him, A much narrower repertoire 
of behavior is under the control of this specific stimulus: if we are to 
behave in a way which he censures, it will now be not only in opposi¬ 
tion to his wishes but brazen. It may also be important that “we 
know that he knows that we know that he is looking at us’’ and so 
on. (What is meant by “know” in these statements is in accord with 
the analysis in Chapters VIII and XVI.) In catching someone’s eye, 
in short, a social stimulus suddenly arises which is important because 
of the reinforcements which depend upon it. The importance will vary 
with the occasion. We may catch someone’s eye in a flirtation, under 
amusing circumstances, at a moment of common guilt, and so on— 
with an appropriate degree of control in each case. The importance 
of the event is seen in the use we make of the behavior of “looking 
someone in the eye” as a test of other variables responsible for such 
characteristics of behavior as honesty, brazenness, embarrassment, 
or guilt. 

Social stimuli are important to those to whom social reinforcement 
is important. The salesman, the courtier, the entertainer, the seducer, 
the child striving for the favor of his parents, the “climber” advanc¬ 
ing from one social level to another, the politically ambitious—all 
are likely to be affected by subtle properties of human behavior, asso¬ 
ciated with favor or disapproval, which are overlooked by many 
people. It is significant that the novelist, as a specialist in the descrip¬ 
tion of human behavior, often shows an early history in which social 
reinforcement has been especially important. 
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4 he social stimulus which is least likely to vary from culture to 
culture is that which controls the imitative behavior described in 
Chapter VII. The ultimate consequences of imitative behavior may be 
peculiar to the culture, but the correspondence between the behavior 
of the imitator and that of the imitatce is relatively independent of 
it. Imitative behavior is not entirely free of style or convention, but 
the special features of the imitative repertoire characteristic of a 
group are slight. When a sizable repertoire has once been developed, 
imitation may be so skillful, so eas\', so “instinctive, that we are 
likely to attribute it to some such special mode of interpersonal con¬ 
tact as empathy. It is easy to point to a history of reinforcement, 
however, which generates behavior of this sort. 


'I’HE SOCIAL EPISODE 

We may analyze a social episode by considering one organism at a 
time. Among the variables to be considered are those generated by a 
second organism. We then consider the behavior of the second organ¬ 
ism. assuming the first as a source of variables. By putting the analyses 
together we reconstruct the episode. The account is complete if it 
embraces all the variables needed to account for the behavior of the 
individuals. Consider, for example, the interaction between predator 
and prey called “stalking.” We may limit ourselves to that behavior 
of the predator which reduces the distance between itself and its prey 
and that behavior of the prey which increases the distance. A reduc¬ 
tion in the distance is positively reinforcing to the predator and 
negatively reinforcing to the prey; an increase is negatively reinforc¬ 
ing to the predator and positively reinforcing to the prey. If the 
predator is stimulated by the prey, but not vice versa, then the preda¬ 
tor simply reduces the distance between itself and the prey as rapidly 
as possible. If the prey is stimulated by the predator, however, it will 
respond by increasing the distance. This need not be open flight, but 
simply any movement sufficient to keep the distance above a critical 
value. In the behavior called stalking the predator reduces the dis¬ 
tance as rapidly as possible without stimulating the prey to increase 
it. When the distance has become short enough, the predator may 
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break into open pursuit, and the prey into open flight. A different 
sort of interaction follows. 

A similar formulation may be applied where “distance” is not so 
simple as in movement in space. In conversation, for example, one 
speaker may approach a topic from which another moves away 
uneasilv. The first may be said to stalk the second if he approaches 
the topic in such a way as to avoid stimulating the second to escape. 
We eliminate the figure of speech in “approaching a topic” by ana¬ 
lyzing the reinforcing and aversive properties of verbal stimuli. 

Another example of a social episode is leading and following. I'his 
generally arises when two or more individuals arc reinforced by a 
single external system which requires their combined action—for 
example, when two men pull on a rope which cannot be moved by 
either one alone. The behavior of one is similar to that of the other, 
and the interaction may be slight. If the timing is important, how¬ 
ever, one man will pace the other. The first sets a rhythmic pattern 
relatively independent of the second; the second times his behavior 
by that of the first. Tlie first may facilitate this by amplifying the 
stimuli which affect the second—as by saying. “All together now, one, 
two, three, puW." Collateral behavior with a marked temporal pattern 
—for example, a sea chanty—may reduce the importance of the leader 
but will not eliminate it. 

The nature of leading and following is clearer when the two kinds 
of behavior differ considerably and the contingency of reinforcement 
is complex. A division of labor is usually then required. The leader is 
primarily under the control of external variables, while the follower 
is under the control of the leader. A simple example is ballroom- 
dancing. The reinforcing consequences—both positive and negative 
—depend upon a double contingency: (1) the dancers must execute 
certain sequences of steps in certain directions with respect to the 
available space and (2) the behavior of one must be timed to cor¬ 
respond with that of the other. This double contingency is usually 
divided between the dancers. The leader sets the pattern and re¬ 
sponds to the available space; the follower is controlled by the move¬ 
ments of the leader and responds appropriately to satisfy the second 
contingency. 
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It is easy to set up cooperative situations with two or more experi¬ 
mental organisms and to observe the emergence of leading and fol¬ 
lowing. In a demonstration experiment two pigeons are placed in 
adjacent cages separated by a glass plate. Side by side near the glass 
are two vertical columns of three buttons each, one column being 
available to each pigeon. The apparatus is set to reinforce both 
pigeons with food but only when they peck corresponding buttons 
simultaneously. Only one pair of buttons is effective at any one time. 
The situation calls for a rather complicated cooperation. The pigeons 
must explore the three pairs to discover which is effective, and they 
must strike both buttons in each pair at the same time. These contin¬ 
gencies must be divided. One bird—the leader—explores the buttons, 
striking them in some characteristic order or more or less at random. 
The other bird—the follower—strikes the button opposite whichever 
button is being struck by the leader. The behavior of the follower is 
controlled almost exclusively by the behavior of the leader, whose 
behavior in turn is controlled by the apparatus which randomizes the 
reinforcements among the three pairs of buttons. Two followers or 
two leaders placed together can solve the problem only accidentally. 
The function of leader may shift from one bird to another over a 
period of time, and a temporary condition may arise in which both 
are followers. The behavior then resembles that of two people who, 
meeting under circumstances where the convention of passing on the 
right is not strongly observed, oscillate from side to side before 
passing. 

Between such an experiment and the relation of leader to follower 
in politics, for example, there is more than a simple analogy. Most 
cultures produce some people whose behavior is mainly controlled 
by the exigencies of a given situation; The same cultures also pro¬ 
duce people whose behavior is controlled mainly by the behavior of 
others. Some such division of the contingencies in any cooperative 
venture seems to be required. The leader is not wholly independent 
of the follower, however, for his behavior requires the support of 
corresponding behavior on the part of others, and to the extent 
that cooperation is necessary, the leader is, in fact, led by his fol¬ 
lowers. 
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Verbal episodes. Verbal behavior supplies many examples in which 
one person is said to have an effect upon another beyond the scope 
of the physical sciences. Words are said to “symbolize” or “express” 
ideas or meanings, which are then "communicated” to the listener. 
An alternative formulation would require too much space hcrc,^ but 
a single example may suggest how this sort of social behavior may be 
brought within range of a natural science. Consider a simple episode 
in which A asks B for a cigarette and gets one. To account for the 
occurrence and maintenance of this behavior we have to show that 
A provides adequate stimuli and reinforcement for B and vice versa. 
A’s response, “Give me a cigarette,” would be quite ineffective in a 
purely mechanical environment. It has been conditioned by a verbal 
community which occasionally reinforces it in a particular way. A 
has long since formed a discrimination by virtue of which the response 
is not emitted in the absence of a member of that community. He 
has also probably formed more subtle discriminations in which he is 
more likely to respond in the presence of an "easy touch.” B has 
either reinforced this response in the past or resembles someone who 
has. The first interchange behvecn the two is in the direction of B 
to A; B is a discriminative stimulus in the presence of which A emits 
the verbal response. The second interchange is in the direction A to 
B: the response generates auditor)^ stimuli acting upon B. If B is 
already disposed to give a cigarette to A—for example, if B is “anxious 
to please A” or “in love with A,” the auditor^' pattern is a discrimina¬ 
tive stimulus for the response of giving a cigarette. B does not offer 
cigarettes indiscriminately; he waits for a response from A as an occa¬ 
sion upon which a cigarette will be accepted. A’s acceptance depends 
upon a condition of depriv'ation in which the receipt of a cigarette is 
reinforcing. This is also the condition in which A emits the response, 
“Give me a cigarette,” and the contingency which comes to control 
B’s behavior is thus established. The third interchange is A’s receipt 
of the cigarette from B. This is the reinforcement of A’s original 
response and completes our account of it. If B is reinforced simply 
by evidence of the effect of the cigarette upon A, we may consider 
B’s account closed also. But such behavior is more likely to remain a 

* See footnote reference, page 210. 
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stable part of the culture if these evidences are made conspicuous. 
If A not only accepts the cigarette but also says, “Thank you,” a 
fourth interchange takes place: the auditory stimulus is a conditioned 
reinforcer to B, and A produces it just because it is. B may in turn 
increase the likelihood of future “Thank you’s” on the part of A by 
saying, “Not at all.” 

When B's behavior in responding to A’s verbal response is already 
strong, we call A’s response a “request.” If B’s behavior requires other 
conditions, we have to reclassify A’s response. If “Give me a ciga¬ 
rette ’ is not only the occasion for a particular response but also a 
conditioned aversive stimulus from which B can escape only by com¬ 
plying, then A’s response is a “demand.” In this case, B’s behavior is 
reinforced by a reduction in the threat generated by A’s demand, 
and A’s “Tliank you” is mainly effective as a conspicuous indication 
that the threat has been reduced. 

Even such a brief episode is surprisingly complex, but the four or 
five interchanges between A and B can all be specified in physical 
terms and can scarcely be ignored if we are to take such an analysis 
seriously. TTiat the complete episode occupies only a few seconds 
does not excuse us from the responsibility of identifying and observ¬ 
ing all its features. 

Unstable interaction. Although many of these interlocking social 
systems are stable, others show a progressive change. A trivial ex¬ 
ample is the behavior of a group of people whp enter an unfamiliar 
room containing a sign which reads, “Silence, please.” Such a verbal 
stimulus is generally effective only in combination with the behavior 
of other members of the group. If many people are talking noisily, 
the sign may have little or no effect. But let us assume that our group 
enters silently. After a moment two members least under the control 
of the sign begin to whisper. This slightly alters the situation for 
other members so that they also begin to whisper. This alters the 
situation for the two who are least under the control of the sign, and 
they then begin to speak in a low voice. This further changes the 
situation for the others, who also begin to speak in low voices. Even¬ 
tually the conversation may be quite noisy. This is a simple “auto- 
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catalytic” process arising from a repeated interchange between the 
members of tlie group. 

Another example is a practice common on sailing ships in the 
eighteenth centur\’. Sailors would amuse themselves by t)'ing several 
boys or younger men in a ring to a mast by their left hands, their 
right hands remaining free. Each boy was given a stick or whip and 
told to strike the bov in front of him whenever he felt himself being 
struck by the boy behind. The game was begun by striking one boy 
lightly. This boy then struck the boy ahead of him, who in turn 
struck the boy next ahead, and so on. Even though it was clearly in 
the interest of the group that all blows be gentle, the inevitable result 
was a furious lashing. The unstable elements in this interlocking 
system are easy to identify. We cannot assume that each boy gave 
precisely the kind of blow he received because this is not an easy 
comparison to make. It is probable that he underestimated the 
strength of the blows he gave. The slightest tendency to give a little 
harder than he received would produce the ultimate effect. More¬ 
over, repeated blows probably generate an emotional disposition in 
which one naturally strikes harder. A comparable instability is seen 
when two individuals engage in a casual conversation which leads to 
a vituperative quarrel. The aggressive effect of a remark is likely to 
be underestimated by the man who makes it, and repeated effects 
generate further aggression. The principle is particularly dangerous 
when the conversation consists of an exchange of notes between 
governments. 

SUPPORTING VARIABLES IN 
THE SOCIAL EPISODE 

Although the interchange between two or more individuals whose 
behavior is interlocked in a social system must be explained in its 
entirety, certain variables may remain obscure. For example, we often 
observe merely that one person is predisposed to act with respect to 
another in certain ways. The mother caring for her child is a familiar 
case in point. The social emotions are by definition observed simply 
as predispositions to act in ways which may be positively or nega¬ 
tively reinforcing to others. Such terms as favor and friendship 
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refer to tendencies to administer positive reinforcement, and love 
might be analyzed as the mutual tendency of two individuals to 
reinforce each other, where the reinforcement may or may not be 
sexual. 

Sometimes a reciprocal interchange explains the behavior in terms 
of reinforcement. Each individual has something to offer by way of 
reinforcing the other, and once established, the interchange sustains 
itself. We may detect mutual reinforcement in the case of mother 
and child. Instead of tendencies to behave in certain ways, they may 
illustrate tendencies to be reinforced by certain social stimuli. Aside 
from this, the group may manipulate special variables to generate 
tendencies to behave in ways which result in the reinforcement of 
others. The group may reinforce the individual for telling the truth, 
helping others, returning favors, and reinforcing others in turn for 
doing the same. The Golden Rule is a generalized statement of the 
behavior thus supported by the group. Many important interlocking 
svstems of social behavior could not be maintained without such 
conventional practices. This is an important point in explaining the 
success of the cultural practices characteristic of a group (Chap¬ 
ter XXVIII). 

To the extent that prior reinforcement by the group determines 
the suitability of the behavior of the individual for an interlocking 
system, the system itself is not wholly self-sustaining. The instability 
is demonstrated when an individual who is not adequately controlled 
by the culture gains a temporary personal advantage by exploiting 
the system. He lies, refuses to return a favor, or breaks a promise, but 
this exploitation of the system eventually leads to its deterioration. 
The boy in the fable cries, “Wolf!" because certain patterns of social 
behavior have been established by the community and he finds the 
resulting behavior of his neighbors amusing. The aggressive door-to- 
door salesman imposes upon the good manners of the housewife to 
hold her attention in the same way. In each case the system even¬ 
tually breaks down: the neighbors no longer respond to the cry of 
“Wolf!” and the housewife slams the door. 

The behavior of two individuals may be related in a social episode, 
not primarily through an interchange between them, but through 
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common external variables. The classic example is competition. Two 
individuals come into competition when the behavior of one can be 
reinforced only at the cost of the reinforcement of the other. Social 
behavior as here defined is not necessarily involved. Catching a rabbit 
before it runs away is not vcia- different from catching it before some¬ 
one else does. In the latter case, a social interchange may occur as a 
by-product if one individual attacks the other. Cooperation, in which 
the reinforcement of two or more individuals depends upon the 
behavior of both or all of them, is obviously not the opposite of com¬ 
petition, for it appears to require an interlocking system. 

THE GROUP AS A BEHAVING UNIT 

It is common to speak of families, clans, nations, races, and other 
groups as if they were individuals. Such concepts as "the group 
mind,” "the instinct of the herd," and “national character ’ have 
been invented to support this practice. It is always an individual who 
behaves, however. The problem presented by the larger group is to 
explain why many individuals behave together. Why does a boy join 
a gang? Why does a man join a club or fall in with a lynching mob? 
We may answer questions of this sort by examining the variables 
generated by the group which encourage the behavior of joining and 
conforming. We cannot do this simply by saying that two individuals 
will behave together cooperatively if it is "in their common interest 
to do so.” We must point to specific variables affecting the behavior 
of each of them. From a practical point of view, as in setting up 
cooperative behavior in the pigeon demonstration just described, an 
analysis of the relevant variables is also essential. The particular con¬ 
tingencies controlling the behavior of the cooperators must be care¬ 
fully maintained. , 

Some progress toward explaining participation m a group is made 

by the analysis of imitation. In general, behaving as others behave is 
likely to be reinforcing. Stopping to look in a store window which 
has already attracted a crowd is more likely to be reinforced than 
stopping to look in store windows which have not attracted crowds. 
Using words which have already been used by others, rather than 
strange terms, is more likely to be reinforced positively or to be free 
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of aversive consequences. Situations of this sort multiplied a thou¬ 
sandfold generate and sustain an enormous tendency to behave as 
others are behaving. 

I o this principle we must add another of perhaps greater impor¬ 
tance. If it is always the individual who behaves, it is nevertheless 
the group which has the more powerful effect. By joining a group the 
individual increases his power to achieve reinforcement- The man 
who pulls on a rope is reinforced by the movement of the rope 
regardless of the fact that others may need to be pulling at the same 
time. Tlie man attired in full uniform, parading smartly down the 
street, is reinforced by the acclaim of the crowd even though it would 
not be forthcoming if he were marching alone. The coward in the 
lynching mob is reinforced when his victim writhes in terror as he 
shouts at him—regardless of the fact that a hundred others are, and 
must be, shouting at him also. The reinforcing consequences gener¬ 
ated by the group easily exceed the sums of the consequences which 
could be achieved by the members acting separately. The total rein¬ 
forcing effect is enormously increased. 

The interchanges within a group and the heightened effect of the 
group upon the environment may be studied within the framework 
of a natural science. They need to be explored further before we 
accept the proposition that there are social units, forces, and laws 
which require scientific methods of a fundamentally different sort. 



CHAPTER XX 


# 


PERSONAL CONTROL 


Let us look at a social episode from the point of view of one 
of the participants. We have seen that A may generate important 
variables affecting the behavior of B. Tlie change in B may not have 
a return effect upon A. For example, B may look in a shop window 
because he sees A doing so although A may be unaffected by B’s 
action. Usually, however, as in many of the examples already ana¬ 
lyzed, the resulting change in B’s behavior has an effect upon A. In 
the important case now to be considered the effect is one of rein¬ 
forcement. A behaves in a way which alters B’s behavior because of 
the consequences which B’s behavior has for A. We say, colloquially, 
that A is deliberately controlling B. This does not mean that A is 
necessarily able to identify the cause or effect of his action. When a 
baby cries for his mother’s attention, he generates an aversive stimu¬ 
lus which he withdraws when the mother pays attention. As a result, 
the behavior of the mother in paying attention is reinforced. Neither 
the baby nor the mother may understand the processes involved, but 
we may still say that the baby has learned how to control his mother 
in this respect. It is this asymmetrical social relation which we have 
now to investigate. Our task is to evaluate the various ways in which 
one person controls another. 


313 
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CONTROL OF VARIABLES 

4 he power to manipulate the conditions affecting another indi¬ 
vidual may be delegated to the controlling individual by one of the 
organized agencies to be discussed in Section V. The controller s rela¬ 
tion to the controllee may then be characterized as that of governor 
to go\'erncd, priest to communicant, therapist to patient, employer 
to employee, teacher to pupil, and so on. But almost everj^one con¬ 
trols some relevant variables, apart from such a role, which he may 
employ to his own advantage. This we may speak of as personal con¬ 
trol. The kind and extent depend upon the personal endowment and 
skill of the controller. The strong man uses the variables which 
derive from his strength. The wealthy man resorts to money. The 
pretty girl uses primary or conditioned sexual reinforcement. The 
weakling becomes a sycophant. The shrew controls through aversive 
stimulation. 

When compared with the practices of organized agencies, per¬ 
sonal control is nevertheless weak. A man of great wealth, a gangster 
with a gun, or an extremely beautiful woman is the occasional excep¬ 
tion to the rule that the individual is rarely, simply as an individual, 
able to alter the variables affecting other people in very important 
ways. But he may to some extent offset this shortcoming because he 
is in an especially favorable position in dealing with the idiosyn¬ 
crasies of the controllee. Organized agencies manipulate variables 
common to groups of people, but the individual can ask whether a 
particular controllee is sensitive to certain kinds of stimuli, whether 
he responds to certain kinds of reinforcement, whether at the 
moment he exhibits certain states of deprivation, and so on. What¬ 
ever variables are available may be more wisely selected and used. 

The limitations of personal control have led to a standard practice 
in which available variables are first manipulated in order to estab¬ 
lish and maintain contact between controller and controllee. If this 
move is successful, further possibilities of control may then be devel¬ 
oped. The first task of the salesman is to keep his prospect within 
range—to keep the housewife at the door or the customer in the shop. 
If he has sufficient control to achieve this, he may then safely develop 
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other lines. Tlie counselor, whether he is simply a friend or a profes- 
sional therapist, faces a similar problem. His first task is to make 
sure that the man he is counseling continues to listen and to return 
for further counsel. If this can be done, other lines of control may 
then be opened. 

The preliminary' stage of maintaining contact with the controllee 
is best seen in the career of the entertainer or, somewhat less obvi¬ 
ously, the writer, artist, or musician. People of this sort exploit their 
relatively poor sources of control almost exclusively to increase the 
probability that the controllee will come back for more. The princi¬ 
pal technique is reinforcement. We might say, in fact, that it is the 
business of the entertainer, writer, artist, or musician to create rein¬ 
forcing events. In the process of creation, as we saw in Chapter XVI, a 
medium may be manipulated to reveal se//-reinforcing properties, 
but the “universality” of a work of art is measured by the number of 
other people who also find it reinforcing. If the artist has no further 
message, this is the extent of the personal control he wields. The 
propagandist, however, advances to a more specific assignment when 
the attention, interest, or patronage of his audience has once been 
assured. 

TECHNIQUES OF CONTROL 

The techniques available in controlling behavior were reviewed in 
Chapter XV in connection with self-control, but there are several 
special features which call for comment in the application to the 
control of others. Physical force is the most immediately effective 
technique available to those who have the necessary' power. In its 
most immediately personal form it is exemplified by the wrestler who 
suppresses the behavior of his opponent through sheer physical re¬ 
straint. Tlie most extreme form of restraint is death: the individual is 
kept from behaving by being killed. Less extreme forms include the 
use of handcuffs, strait jackets, jails, concentration camps, and so on. 
These all suggest violent control, often for extremely selfish pur¬ 
poses, but even highly civilized societies use physical restraint in the 
control of children, criminals, and the dangerously insane. 

The use of force has obvious disadvantages as a controlling tech- 
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niqiie. It usually requires the sustained attention of the controller. 
It is almost exclusively concerned with the prevention of behavior, 
and hence is of little value in increasing the probability of action. 
It generates strong emotional dispositions to counterattack. It cannot 
be applied to all forms of behavior; handcuffs restrain part of a man’s 
rage but not all of it. It is not effective upon behavior at the private 
lc\cl. as we suggest when we say that one cannot imprison a man’s 
thoughts. 

For all these reasons, control through physical restraint is not so 
promising a possibility as it may at first appear. It is, of course, never 
available to those who lack the necessar\’ power. In the long run the 
use of force usually gives way to other techniques which employ 
genuine processes of behavior. Here the controller need not have the 
power to coerce or restrain behavior directly but may affect it indi- 
rcctlv by altering the environment. 

Manipulating stimuli. Most of the techniques of self-control 
through the manipulation of stimuli may be directly extended to 
the behavior of others. We present unconditioned or conditioned 
stimuli to elicit reflex responses when we give an emetic to induce 
vomiting; and we arrange discriminative occasions for behavior when 
we display merchandise in a store in such a way that the customer is 
more likely to purchase it. We use stimuli to eliminate behavior by 
evoking incompatible responses. When women employed in a fac¬ 
tory created a hazard by huriy’ing down a corridor at the end of the 
day, the manager put mirrors along the corridor to evoke responses 
of adjusting wearing apparel and applying cosmetics. This behavior 
proved to be incompatible with hurrying. We use supplemental stim¬ 
uli to induce behavior when we “interpret a situation favorably,” as 
when the salesman assures the potential buyer that he will enjoy or 
profit from a purchase, or when we encourage someone to join us on 
a given occasion by assuring him of enjoyable consequences. A par¬ 
ticularly effective mode of stimulation evokes the imitative repertoire 
discussed in Chapters VII and XIX: the businessman who is resorting 
to alcohol as a technique of control induces his prospect to have another 
drink by ordering another himself. The imitative repertoire is the 
basis of testimonial advertising. People are shown using various prod- 
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nets and engaging in various activities, and the effect is to strengthen 
comparable behavior in the viewer. The whole field of verbal behav¬ 
ior exemplifies the use of stimuli in personal control. ITie speaker 
generates auditors* patterns which are effective because of the lis¬ 
tener’s history in a given verbal community. 

Reinforcement as a technique of control. If the individual possesses 
money or goods, he may use them for purposes of reinforcement in 
the form of wages, bribes, or gratuities. If he is in a position to do 
someone a favor, he can reinforce accordingly. He may also be able 
to offer his own physical labor, cither to an employer in return for 
wages or to a friend in return for a particular action. Sexual stimula¬ 
tion is a common form of reinforcement and is widely used in 
personal control. 

In practice many of these reinforcers are preceded by more imme¬ 
diate conditioned reinforcers. Money is itself a conditioned rein- 
forcer, but primary reinforcement may be further postponed when a 
check is given which is later converted into cash. Contracts and 
verbal promises are other forms of conditioned reinforcers available 
in personal control. Minor examples include praise and thanks. 
These deferred reinforcements are likely to be unreliable, however. 
Praise may give way to flatter)', checks may not be honored, and 
promises may be made in bad faith. But it may be some time before 
the interlocking social system deteriorates to the point at which 
there is no longer a reinforcing effect. 

Aversive stimulation. Negative reinforcement is employed in per¬ 
sonal control in the aversive cr)' of the child and the nuisance value 
of the behavior of an adult. Control is achieved by making the with¬ 
drawal of these aversive stimuli contingent upon the response to be 
strengthened. Forgiveness and acquittal are similarly reinforcing. 
The bully who pommels another boy until he cries “Uncle!”, the 
police who employ the third degree to obtain a confession, and the 
nation which makes war until the enemy surrenders, exemplify the 
same use of aversive stimulation. Conditioned aversive stimulation 
used in the same way is exemplified by the “dare or by other ways 
of shaming someone into acting. 
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Punishment. The individual who is able to present a positive rein¬ 
forcement or withdraw a negative is usually also able to present the 
negative or withdraw the positive and is therefore able to punish. 
Punishment is not to be confused with physical restraint or the use 
of aversive stimulation. All three forms of control are usually avail¬ 
able to the same individual because of the nature of the power of 
control, but confining a man in jail to keep him from behaving in a 
certain wav or to induce him to behave in a certain way in order to 
be released is not the same as confining him in order to reduce his 
tendency to behave in a given way in the future. In the control of psy¬ 
chotic patients confinement is a means of restraint rather than pun¬ 
ishment; and, conversely, some forms of punishment involve at best 
only momentary’ restraint. Punishment as a technique of control has 
all the disadvantages of physical restraint and, in addition, all the 
weaknesses pointed out in Chapter XII. Moreover, it generates emo¬ 
tional dispositions which may be disadvantageous or even dangerous 
to both controller and controllee, as we shall see in discussing psycho¬ 
therapy in Chapter XXIV. 

Punishment as the removal of positive reinforcers, conditioned or 
unconditioned, is exemplified by cutting a dependent off “without a 
cent,” refusing to supply food or shelter previously given, imposing 
economic sanctions, and refusing customary sexual contact. Another 
important example is withholding customary social stimulation, as 
in snubbing an acquaintance or “putting a schoolboy on silence.” 
Lesser degrees of such punishments are social neglect and inattention. 
None of these are punishments in their own right, but only when 
made contingent upon behavior. 

Punishment in the form of presenting aversive stimuli is commoner. 
Physical injury is exemplified by spanking a child, striking an adult, 
and attacking a nation. Conditioned aversive stimuli, many of them 
verbal, are exemplified by disapproval and criticism, by damning and 
cursing, by ridicule, and by the carry'ing of bad news. These again are 
punishments only when contingent upon behavior. We have seen 
that it is questionable whether they permanently reduce any tendency 
to behave. They all generate emotional dispositions which are par- 
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ticiilarly disorganizing and which may in turn call for further remedial 
control. 


Pointing up contingencies of reinforcement. It is possible to use 
techniques based upon reinforcement and punishment without being 
able to control the events in question. A considerable effect may be 
achieved simply by clarifying the relation between behavior and its 
consequences. The instructor in sports, crafts, or artistic activities 
may directly reinforce the behavior he is tiring to establish, but he 
may also simply point up the contingency between a given form of 
behavior and the result—“Notice the effect you get when you hold 
the brush this way,” “Strike the key this way and see if it isn’t easier,” 
“If you swing the club this way, you won’t slice the ball,” and so on. 
The controller may make use of reinforcing events which have oc¬ 
curred without his inten'ention by making the contingencies more 
likely to modify the behavior of the controllee. Punishing consc- 
cjuences are pointed up by such expressions as “Now, sec what you ve 
done,” "This is costing you money," or "You are responsible for all 
this.” Other techniques of emphasizing reinforcing contingencies 
consist of arranging various schedules of reinforcement—“Play this 
passage until you can play it without a mistake”—and programs of 
differential reinforcement—"When you can clear the bar at this 
height, move it one inch higher.” 


Deprivation and satiation. If we are controlling a child’s behavior 
through reinforcement with candy, it is well to make sure that little 
candy is received at other times. Deprivation may also be used to 
control behavior which has been strengthened by generalized rein- 
forcers. To evoke behavior which has been reinforced with money, 
one procedure is to deprive the individual in such a way as to 
strengthen behavior which can be executed only with money. For 
example, a man is made susceptible to bribery by encouraging him to 
follow a mode of living in which money is an important requirement. 
Satiation is a common technique of control which is particularly 
effective in eliminating unwanted behavior. A child stops teasing for 
candy when he is given all he will eat. One may satiate an aggressor 
by submitting to him—by “turning the other cheek.” 
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Emotion. \Vc are sometimes interested in controlling the reflex 
responses characteristic of emotion, as in making someone laugh, 
blush, or cr\-. We are more likely to be interested in establishing 
emotional predispositions. Wc have noted the important case in 
which someone is “favorably inclined tow^ard a particular person or 
set of circumstances. Building morale is usually concerned with gen¬ 


erating such a predisposition. The effect often follows from the same 
events which reinforce behavior. Gratuities, for example, ser\'e as a 
mode of control not only through reinforcement but by generating 
“favorable attitudes.” More specific predispositions are also generated 
with appropriate stimuli—as when Christmas music is played in a 
store to encourage “good will toward men” and the purchase of gifts. 
Other techniques of altering emotional predispositions are suggested 


by terms like “jollying,” “cajoling,” “haranguing.” “seducing, ‘ incit¬ 
ing,” “allaying fear,” and “turning away wrath.” I'he actual variables 
responsible for a given predisposition need to be analyzed in each 


case. 


The use of drugs. The drug most commonly used in personal con¬ 
trol is alcohol. Like certain emotional operations it is often used to 
dispose an individual toward favorable action. It appears also to act 
directly in reducing anxieties or alarm and may be used for that 
reason—for example, in closing a business deal or in getting someone 
to talk about a confidential matter. It is also used as a positive rein- 
forccr. As a habit-forming drug it makes possible a special form of 
deprivation, in which behavior which has been reinforced with alco¬ 
hol may be made so powerful that the individual will “do anything” 
for a drink. Such drugs as morphine and cocaine have, as we have 
seen, been used to create the possibility of using other powerful 
deprivations for the same purpose. Other drugs are employed in the 
control of psychotic behavior and in connection with governmental 
or police functions—for example, the so-called truth serums. 


OBJECTIONS TO PERSONAL CONTROL 

Students of human behavior often avoid the issue of control and 
even regard it as in bad taste to suggest that deliberate control is 
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ever undertaken. Tlie codification of controlling practices is left to 
the Machiavellis and Lord Chesterfields. Psychologists, sociologists, 
and anthropologists usually prefer theories of behavior in which con¬ 
trol is minimized or denied, and we shall see that proposed changes 
in governmental design arc usually promoted by pointing to their 
effect in maximizing freedom. All this appears to be due to the fact 
that control is frequently aversive to the controllcc. 'Pechniques based 
upon the use of force, particularly punishment or the threat of pun¬ 
ishment, are aversive by definition, and techniques which appeal to 
other processes arc also objectionable when, as is usually the case, 
the ultimate advantage to the controller is opposed to the interest 
of the controllcc. 

One effect upon the controllcc is to induce him to engage in 
countercontrol, lie may show an emotional reaction of anger or 
frustration including operant behavior which injures or is otherwise 
aversive to the controller. Such behavior may have been reinforced 
by the reduction in similar aversive consequences. The importance 
of reinforcement is seen in the fact that we are much more likely to 
respond in this way to social than to nonsocial control. If we are 
forced to step off the sidewalk by a large branch blown down by the 
wind, we shall probably not exhibit a strong emotional reaction, but 
if wc are forced to step off in the same way by a group of idle people, 
aggressive behavior—verbal and nonverbal—may be generated. The 
aggressive behavior has probably alleviated similar social conditions 
but has had little or no effect upon branches of trees. It is not neces¬ 
sarily more “natural” to react emotionally to social than to nonsocial 

restraint. 

Because of the aversive consequences of being controlled, the indi¬ 
vidual who undertakes to control other people is likely to be counter- 
controlled by all of them. The power which “other people” generate 
when they act as a group is discussed in Chapter XXL Part of such 
countercontrol is assigned to specific religious or governmental 
agencies which possess the power to manipulate important variables. 
TTie opposition to control is likely to be directed toward the most 
objectionable forms—the use of force and conspicuous instances of 
exploitation, undue influence, or gross misrepresentation-but it may 
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extend to any control which is “deliberately’ exerted because of the 
consequences to the controller. As a result of the principal technique 
employed in countcrcontrol, the individual who engages in control 
automatically generates conditioned aversive self-stimulation—he 
‘ feels guilty” about exerting control. He is then automatically rein¬ 
forced for doing something else, for giving up any attempt to control, 
and for declaring himself opposed to personal control in general. 

riic countercontrol exercised by the group and by certain agencies 
may explain our hesitancy in discussing the subject of personal con* 
trol franklv and in dealing with the facts in an objective way. But 
it docs not excuse such an attitude or practice. This is only a special 
case of the general principle that the issue of personal freedom must 
not be allowed to interfere with a scientific analysis of human be¬ 
havior. As we have seen, science implies prediction and, insofar as 
the relevant variables can be controlled, it implies control. We can¬ 
not expect to profit from applying the methods of science to human 
bcliavior if for some extraneous reason we refuse to admit that our 
subject matter can be controlled. I’he advantage of this general 
principle is well illustrated by the present point: those who are most 
concerned with restricting personal control have most to gain from 
a clear understanding of the techniques employed. 



CHAPTER XXI 


GROUP CONTROL 


The individual is subjected to a more powerful control when 
two or more persons manipulate \'ariables having a common effect 
upon his behavior. This will happen if two or more persons are moved 
to control him in the same way. The condition is usually fulfilled 
when the members of a group compete for limited resources. A social 
system, in the sense of Chapter XIX, is then established in which one 
man’s positive reinforcement is another man’s negative. In the ex¬ 
pression. “the spoils of war,” the reinforcement of the conqueror is 
named for its aversive effect upon the conquered. Tlie child who 
takes a toy from another is thereby reinforced, but the loss of the toy 
is aversive to the other child. Tlie successful suitor inevitably creates 

an aversive condition for other suitors. 

Since an individual may affect all other members of a group in this 
way, their countercontrol may be undertaken in concert. All the 
other members become what we may designate as the controlling 
group. The group acts as a unit insofar as its members are affected 
by the individual in the same way. It need not be highly organized, 
but some sort of organization usually develops. Controlling prac¬ 
tices acquire a certain uniformity from the cohesive forces which lead 
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individuals to take part in group action (Chapter XIX) and from their 
mode of transmission from one generation to another. 

I'hc principal technique employed in the control of the individual 
by any group of people who have lived together for a sufficient length 
of time is as follows. The behavior of the individual is classified as 
either “good” or “bad” or, to the same effect, “right” or “wrong” and 
is reinforced or punished accordingly. We need not seek far for a 
definition of these controversial terms. The behavior of an individual 
is usually called good or right insofar as it reinforces other members 
of the group and bad or wrong insofar as it is aversive. The actual 
practices of the group may not be completely consistent with these 
definitions. The initial classification may have been accidental: a 
conspicuous bit of behavior which was only adventitiously correlated 
with reinforcing or aversive events came to be classed as good or bad 
accordingly. Our definition applies literally to the origin of such a 
superstitious practice but does not fit any current effect. A classifica¬ 
tion of behavior may also continue in force long after it is out of date: 
behavior often continues to be branded good or bad although, through 
some change in conditions, it is no longer reinforcing or aversive. 

'I'hc classification may also be defective because of the faulty 
structure of the group. All members may not participate to the same 
extent. Since an act may have different effects upon different mem¬ 
bers, some of whom may, therefore, classify it as good and others as 
bad, subdivisions of the group may conflict with each other in the 
direction of their control. For example, the use of physical force is 
generally aversive to others and hence called bad, but it may be 
classified as good by those who exhibit similar behavior in controlling 
a third party, either within or outside the group. Behavior which is 
immediately reinforcing may have a long-term aversive effect. The 
behavior of seduction or of exerting “undue influence” is often 
effective through positive reinforcement, but the ultimate conse¬ 
quences may lead the victim, as well as others, to classify it as bad. 

Tlie group as a whole seldom draws up a formal classification of 
behavior as good or bad. We infer the classification from our obser¬ 
vations of controlling practices. A sort of informal codification takes 
place, however, when the terms themselves come to be used in rein- 
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forcement. Perhaps the commonest generalized rcinforccrs arc the 
verbal stimuli “Good," “Right," "Bad,” and “Wrong.” These arc 
used, together with unconditioned and other conditioned rcinforccrs 
such as praise, thanks, caresses, gratuities, favors, blows, blame, cen¬ 
sure, and criticism, to shape the behavior of the individual. 

The actual controlling practices arc usually obvious. Good be¬ 
havior is reinforced, and bad behavior punished. The conditioned 
aversive stimulation generated by bad behavior as the result of pun¬ 
ishment is associated with an emotional pattern commonly called 
“shame.” The individual responds to this when he “feels ashamed of 
himself.” Part of what he feels arc the responses of glands and smooth 
muscles recorded by the so-called lie detector (Chapter X). 'I’he 
relevance of this instrument to he detection is based upon the fact 
that lying is frequently punished. Another part of the reaction of 
shame is a conspicuous change in normal dispositions—the social 
offender acts in a shamefaced manner. Any or all of these emotional 
conditions may be directly or indirectly aversive, in which case they 
combine with other conditioned aversive stimulation m providing 
for the reinforcement of behavior which displaces or othersvise re¬ 
duces the probability of the punished response. The best example of 
such behavior is self-control. The group also directly reinforces prac¬ 
tices of self-control. 


WHY THE GROUP EXERTS CONTROL 

In explaining any given instance of group control we have to show 
how the behavior of the controller is interlocked with that of the 
controllee in a social system. We must also show that both are ade¬ 
quately accounted for by the specified variables. In a given instancy 
good behavior on the part of A may be positively reinforced by B 
because it generates an emotional disposition on the part of B to do 
good” to A. This explanation is not very satisfactory because it simply 
appeals to a standing tendency to do good. But it seems clear, simply 
as a matter of observation, that the behavior of favoring another is 
modified by appropriate emotional circumstances and that good 
behavior on the part of another is a case in point. The mother rein- 
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forces licr chile] in a burst of affection when the child’s behavior is 
especially good or right. 

Another possibility is that the group appropriately reinforces good 
behavior just because the probability of similar behavior in the future 
is thus increased. The gratuity may be given to guarantee similar 
scr\icc in the future; it then has nothing to do with gratitude as an 
emotional disposition to favor others. The community also teaches 
each member to thank or praise the individual who has behaved well 
and to do so even when the member himself is not directly affected. 
An act of heroism is acclaimed by many people who have not, in this 
instance, been positively reinforced. The educational practice gener¬ 
ates good behavior in the individual by assuring the proper reinforcing 

behavior on the part of the group. 

The emotional dispositions which lead the members of a group to 
punish bad behavior are, unfortunately, more obvious. Anyone who 
injures others, deprives them of property, or interferes with their 
bchav'ior generates a heightened inclination toward counterattack. 
This statement is again merely an appeal to an obsersed increase in 
the tendency of individuals to act aggressively under certain circum¬ 
stances, but there are variables outside the field of emotion which 
work in the same direction. If A’s aggression is momentarily reduced 
through B’s countcragression (we have seen, of course, that the long¬ 
term effect is different), B will be reinforced. B’s behavior in punish¬ 
ing A may thus be due simply to operant reinforcement. It is some¬ 
times argued that an emotional disposition to counterattack is the 
basic variable—that we always “strike a child in anger,” and that any 
interpretation of the behavior as “intellectual” is a mere rationaliza¬ 
tion (Chapter XVIII). But the practice could arise in the absence of 
an emotional variable; one could punish objectionable behavior 
simply to reduce the probability that it will recur. Educational agen¬ 
cies also encourage the use of punishment to control bad behavior, 
and they generate a tendency to exert the control even though the 
individual himself is not at the moment involved. The agency may 
work through emotional variables—for example, by generating re¬ 
sentment or indignation with respect to dishonesty, theft, or murder 
—or through operant reinforcement by appeal to the consequences. 
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'HIE EFFECT OF GROUP CONTROL 

The control exercised by the group works to at least the temporal^' 
disadvantage of the individual. The man who has been positively 
reinforced for gi\'ing his possessions and sers'ices to others may find 
himself thoroughly despoiled. The group has generated behavior 
which, although it achieves the positive reinforcement accorded good 
behavior, also creates strongly aversive conditions for the individual. 
Among the forms of good behavior strengthened by the community 
are practices of self-control in which behavior which might result in 
extensive reinforcement is weakened. 1 hat the individual suffers 
when bad behavior is punished is more obvious. Punishment itself is 
aversive, and behavior which works to the advantage of the individual 
at the expense of others is, temporarily at least, suppressed. Punish¬ 
ment is also the principal variable responsible for the behavior of 
self-control, which, as we have just seen, also reduces primary rein¬ 
forcement. 

In short, the effect of group control is in conflict with the strong 
primarily reinforced behavior of the individual. Selfish behavior is 
restrained, and altruism encouraged. But the individual gains from 
these practices because he is part of the controlling group with re¬ 
spect to every other individual. He may be subject to control, but he 
engages in similar practices in controlling the behavior of others. 
Such a system may reach a “steady state” in which the individual’s 
advantages and disadvantages strike some sort of balance. In such a 
state a reasonable control over the selfish behavior of the individual 
is matched by the advantages which he gains as a member of a group 
which controls the same selfish behavior in others. 

The power of the group is, of course, great. Even the political 
tyrant, the despotic father, the bully in the street gang, or any other 
exceptionally strong individual usually yields eventually to the group 
as a whole. The less talented may be wholly submerged by it. In dis¬ 
cussing psychotherapy in Chapter XXIV we shall consider some of the 
consequences of excessive control. Fortunately, the group seldom acts 
efficiently enough to press its advantage to the limit, and its full 
power is probably never felt. Classifications of behavior as “good,” 
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"bad/’ "right,” or "wrong” are seldom clear-cut. And they are not 
consistently supported by all members of a group. Certain organized 
subdivisions of the group, however, may make better use of their 
power, as we shall see in Section V. 


JUSTIFICATION OF GROUP CONTROL 

Certain familiar questions in the field of ethics may have occurred 
to the reader. What do we mean by the Good? How may we encour¬ 
age people to practice the Good Life? And so on. Our account does 
not answer questions of this sort in the spirit in which they are usu¬ 
ally asked. Within the framework of a natural science certain kinds 
of behavior are observed when people live together in groups kinds 
of behavior which are directed toward the control of the individual 
and which operate for the advantage of other members of the group. 
Wc define “good” and "bad,” or “right” and "wrong,” with respect 
to a particular set of practices. We account for the practices by noting 
the effects which they have upon the individual and in turn upon the 
members of the group, according to the basic processes of behavior. 

Ethics is usually concerned with justifying controlling practices 
rather than with merely describing them. Why is a particular bit of 
behavior classed as good or bad? The question is sometimes answered 
by asserting that "good” and "bad" have been defined by supernatural 
authorities. Although a science of behavior might help in designing 
educational practices which would encourage people to be good and 
dissuade them from being bad according to a given authority, it can 
scarcely pass upon the validity of such a definition. When it can be 
shown that a classification leads to results which are positively rein¬ 
forcing to the individual who reveals the word of authority, another 
sort of explanation is available. Such an explanation need not ques¬ 


tion the ultimate, possibly beneficial, effect of a classification. 

Attempts have been made to avoid an appeal to authority by find¬ 
ing other bases for a definition. It has been argued that a particular 
form of individual behavior, or the controlling practice which pro¬ 
duces it, is to be recommended if it can be shown to work for the 
"greatest good of the greatest number,” to increase the "sum total 
of human happiness,” to maintain the "equilibrium” of a group, and 
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SO on. The original problem remains, however, because we still have 
to justify the criteria. Why do we choose the greatest good or the 
sum total of human happiness or equilibrium as a basis for a defini¬ 
tion? A science of behavior might be able to specif)' behavior which 
would or would not make for happiness, but the question remains 
whether it can decide that happiness is “best ' in the ethical sense. 
Here again we may be able to show that practices which are justified 
in terms of happiness have consequences which arc reinforcing to 
the proponents of such a justification. It is their happiness which 
is primarily affected. But this is also irrelevant to the ultimate effect 
of the classification. 

Such a criterion as the “greatest good of the greatest number” 
represents a type of explanation, based upon the principle of maxima 
and minima, which has often proved useful in the physical sciences. 
In the field of behavior, however, the definition of what is being 
maximized or minimized is unsatisfactor)'—as we might suspect 
from the enormous amount of discussion which terms like “the great¬ 
est good” have provoked. Even if these terms could be defined, the 
practice of characterizing a controlling practice as maximizing or 
minimizing some such entity is very different from an analysis in terms 
of relevant variables. It is not impossible that the two could be shown 
to be compatible if physical dimensions could be assigned to the thing 
maximized, but this has not been done in the traditional study of 
ethics. Tlie program of a functional analysis offers a course of action 
in which the problem of the definition of such entities may be 

avoided. 

Obviously an important feature of any group is the extent to which 
it exercises control over each of its members. We shall return in 
Section VI to the question of whether a science of human behavior 
provides any basis for determining the most expedient extent of such 
control. This problem is quite independent of an analysis of actual 
controlling practices. 
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CONTROLLING AGENCIES 

The group exercises an ethical control over each of its mem- 
bers mainly through its power to reinforce or punish. The power is 
derived from sheer number and from the importance of other people 
in the life of each member. Usually the group is not well organized, 
nor are its practices consistently sustained. Within the group, how¬ 
ever, certain controlling agencies manipulate particular sets of vari¬ 
ables. These agencies are usually better organized than is the group 
as a whole, and they often operate with greater success. 

The agencies to be considered in this section are chosen from the 
fields of government, religion, psychotherapy, economics, and edu¬ 
cation. These are very broad areas, of course, which cannot be ade¬ 
quately treated here. Fortunately, for our present purposes we do not 
need an exhaustive account of the historical and comparative facts 
about particular religions, governments, economic systems, and so 
on We are concerned only with the conceptions of the behaving 
individual which are encountered in these fields. Theology usually 
has much to say of man in his relation to the universe. Theories of 
government frequently describe man as a political animal or as a 
responsible agent under the law. Psychotherapy is particularly rich 
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in “systems” of human behavior, and “economic man has figured 
prominently in economic theor^^ A special psychology has been de¬ 
veloped in the field of education. 

These theories of human behavior are seldom, if ever, satisfactory 
even in their appropriate fields, and a broader objection may be urged 
against them. Each conception is based upon a particular set of facts 
and is de\cloped and used primarily to explain these facts alone, 
d’he conception developed in one field is seldom applied, and never 
effectively applied, to another. What the political scientist has to 
say about man proves to be of little value to the psychotherapist, 
while the individual who emerges from educational psycholog)' bears 
no familial resemblance to economic man. It is not likely that the 
human organism is compartmentalized in this way. We might arrive 
at a formulation of behavior which could be applied to any field by 
considering all the historical and comparative facts at once. There is 
a simpler way, however. Our conception of human behavior need not 
be deduced from the complex facts which it must eventually explain. 
We are not required, for example, to discover the characteristics of 
the political animal through a study of the facts of government. If 
the political animal is man himself, we may study him elsewhere and 
often under better conditions. A functional analysis of behavior pro¬ 
vides us with a basic conception with which we may approach each 
of these fields in turn. We may be interested primarily in testing such 
an analysis by discovering whether it yields a plausible account of the 
behavior of the individual in each case, but if we can achieve such an 
account, then a considerable advantage may be claimed over tradi¬ 
tional formulations. Not only will our analysis in each case have the 
support of the scientific study of the individual under optimal con¬ 
ditions of observation, it will be common to all fields. It will then be 
possible to consider the effect upon the individual of the total cul¬ 
ture, in which all our controlling agencies and all the other features 
of the social environment work together simultaneously and with a 
single effect. 

In discussing controlling agencies we are concerned specifically 
with certain kinds of power over variables which affect human be¬ 
havior and with the controlling practices which can be employed 
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because of this power. Possibilities which are as yet unrealized may 
be as important as the practices of which histoiy has already provided 
examples. A controlling agency, together with the individuals who are 
controlled by it, comprises a social system in the sense of Chapter XIX, 
and our task is to account for the behavior of all participants. We 
must identify the individuals composing the agency and explain why 
they have the power to manipulate the variables which the agency 
employs. We must also analyze the general effect on the controllee, 
and show how this leads to a return reinforcement which explains the 
continuing existence of the agency. All the preceding analysis is 
needed in doing this. The classification of controlling variables, the 
study of basic processes, and the analysis of complex arrangements 
of variables and of the interaction of two or more individuals in a 
social system are all indispensable. 

THE GOVERNMENTAL AGENCY 

Perhaps the most obvious type of agency engaged in the control of 
human behavior is government. Traditional studies in political science 
deal with the history and properties of actual governments, with 
various types of governmental structure, and with the theories and 
principles which have been offered to justify governmental practices. 
We shall be concerned here principally with the behavioral processes 
through which a government exercises control. We have to examine 
the resulting behavior of the governed and the effect of this behavior 
which explains why the agency continues to control. 

Narrowly defined, government is the use of the power to punish. 
Although this definition is sometimes offered as exhaustive, govern¬ 
mental agencies often resort to other kinds of control. The source of 
the power to punish determines the composition of the agency in the 
stricter sense. The strong or clever man is a sort of personal govern¬ 
ment whose power derives from his strength or skill. He may acquire 
henchmen who exercise the actual control over the group but who are 
in turn controlled by him through personal strength or skill. The 
underworld gang often shows a governmental structure of this sort. In 
the organized government of a modem state the specific task of pun¬ 
ishment is assigned to special groups—the police and military. Their 
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power is iisuallv sheer physical force, amplified by special equipment, 
but the power of the ultimate governmental agency may be of a 
different nature. For example, the police and militaiy' may be re¬ 
cruited after appropriate education, they may be controlled through 
ecojiornic measures, or they may act under religious pressure. 

Power which is derived from the “consent of the governed” also de¬ 
termines the composition of the appropriate agency. To say that 
power is “delegated” docs not describe the actual process. An ade¬ 
quate analysis of such a government would include a study of the 
techniques used by the individual in becoming a member of the 
agency and in maintaining himself as such. This is roughly the field 
of practical politics. I’he individual must induce the group to assign 
governmental power to him, and once in office he must maintain his 
connection with this source. The techniques employed by an indi¬ 
vidual will be similar to those of a political machine or party. 

In the long nin the power of a government which has the consent 
of the governed derives from a congruence of function between gov¬ 
ernmental and ethical control (Chapter XXI). If the police or military 
are controlled through economic means, the group supplies the neces- 
sar\ money through taxation. Members of the group may volunteer 
or be conscripted to scrv'c in the police or military. Since religious 
control often derives support from the same source (Chapter XXIII), 
it is not unusual to find a considerable overlap in the composition of 
religious and governmental agencies. Once an agency with a particu¬ 
lar membership is in power, however, it may insure its own support 
through the use of the power to punish rather than through appeal 
to the congruence of its function with that of the ethical group. Not 
everyone pays taxes simply because of group pressure. We are not 
concerned here, however, with the various kinds of ultimate power 
in government or with the internal control which maintains the 
structure of the agency or makes it function smoothly. The effect 
upon the governed is the point at issue. 

TECHNIQUES IN GOVERNMENTAL CONTROL 

Where the group classifies behavior as “right'' or “wrong” for pur¬ 
poses of ethical reinforcement, the governing agency adopts a dis- 
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tinction between ’icgal” and “illegal.” I'lie terms arc defined roughly 
in relation to the souree of power of the agency. Under an absolute 


ruler behavior is illegal if it has aversive consequences for the agency. 
To the extent that the power of the government derives from the 


group, the definitions approach those of “right” and “wrong.” Since 
the governmental agency operates principally through the power to 


punish, however, the emphasis is upon “wrong.” A government uses 
its power to “keep the peace”—to Testrain behavior which threatens 
the property and persons of other members of the group. A govern¬ 
ment which possesses only the power to punish can strengthen legal 
behavior only by making the removal of a threat of punishment con¬ 
tingent upon it. This is sometimes done, but tlic commoner technique 
is simply to punish illegal forms of behavior. 

Some governmental punishments consist of removing positive rc- 
inforcers—for example, dispossessing a man of property, fining him, 
taxing him punitively, or depriving him of contact with society 
through incarceration or banishment. Other common punishments 
consist of presenting negative reinforcers—for example, inflicting 
physical injur)- as in flogging, threatening injur)- or death, imposing 
a sentence at liard labor, exposing the individual to public ridicule 


in the stocks, and aversivcly stimulating the individual in minor ways 
as bv requiring him to report in person to a police station where the 
principal punishment is simply the time and labor consumed in re¬ 
porting. In practice, these punishments are made contingent upon 
particular kinds of behavior in order to reduce the probability that 
the behavior will occur again. A direct weakening as the opposite 
effect of reinforcement is, as we have seen, unlikely. Instead, condi¬ 
tioned aversive stimuli are produced, one effect of which resembles 
the “sense of shame” of group control. WTen this results from gov¬ 
ernmental punishment, the commoner term is “guilt.” The process 
provides for the automatic reinforcement of responses which are in¬ 
compatible with illegal behavior. As the net effect of governmental 
control, then, illegal behavior comes to generate aversive stimuli 
which make the individual “feel guilty” and which provide for the 
automatic positive reinforcement of behaving legally. 

A controlling technique usually associated with an emphasis upon 
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punishment is the establishment of obedient behavior. This is often 
a characteristic of personal control—for example, in the relation be¬ 
tween parent and child. It is seen as a by-product of auxiliary tech¬ 
niques in the field of education when the pupil is taught obedience 
to his teacher. It is a staple product of governmental control. In the 
broadest sense the controlled individual is obedient to the dictates 
of the agency if he behaves in conformity with its controlling prac¬ 
tices, but there is a special form of obedience in which a particular 
response is brought under the control of a verbal command. As a 
verbal stimulus a command serves a double function. It specifies 
behavior to be carried out, and it generates an aversive condition 
from which only that behavior will bring escape. The command is, 
of course, a familiar feature of military training. A selected repertoire 
of responses is brought under the control of appropriate verbal stim¬ 
uli, which may then be used to time or otherwise coordinate the 
behavior of the members of a group. Tlie civilian shows a comparable 
repertoire when he obeys traffic signals or a traffic policeman. But 
obedience to the government is more than a selected repertoire. Any 
behavior commanded by the government—in actual fact by “persons 
in authority” who are able to exert governmental control—is even¬ 
tually carried out within the range of the verbal history of the indi¬ 
vidual. The group exercises a control of this sort to the extent that 
the imperative mood prevails in eveiyday discourse. By establishing 
obedient behavior, the controlling agency prepares for future occa¬ 
sions which it cannot otherwise foresee and for which an explicit 
repertoire cannot, therefore, be prepared in advance. WTien novel 
occasions arise to which the individual possesses no response, he 
simply docs as he is told. 

LAW 

An important point in the development of a government agency is 
the codification of its controlling practices. The study of law or juris¬ 
prudence is usually concerned with the codes and practices of specific 
governments, past or present. It is also concerned with certain ques¬ 
tions upon which a functional analysis of behavior has some bearing. 
What is a law? What role does a law play in governmental control? 
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In particular, what effect does it have upon the behavior of the con- 
trollee and of the members of the governmental agency itself? 

A law usually has two important features. In the first place, it speci¬ 
fies behavior. Tlie behavior is usually not described topographically 
but rather in terms of its effect upon others—the effect which is the 
object of governmental control. When we arc told, for example, that 
an individual has “committed pcrjur\%” we arc not told what he has 
actually said. “Robberv” and “assault” do not refer to specific forms 
of response. Only properties of behavior which are aversive to others 
are mentioned—in perjury' the lack of a customary correspondence 
between a verbal response and certain factual circumstances, in rob¬ 
ber)' the removal of positive reinforcers, and in assault the aversive 
character of physical injur)'. In the second place, a law specifies or 
implies a consequence, usually punishment. A law is thus a statemerit 
of a contingency of reinforcement maintamed by a governmental 
agency. The contingency may have prevailed as a controlling prac¬ 
tice prior to its codification as a law, or it may represent a new prac¬ 
tice which goes into effect with the passage of the law. Laws are thus 
both descriptions of past practices and assurances of similar practices 
in the future. A law is a rule of conduct in the sense that it specifies 
the consequences of certain actions which in turn “rule” behavior. 

The effect of a law upon the controllec. To show how the individ¬ 
ual actually comes to abide by a code, we should have to analyze 
how he learns not to lie, not to steal, not to assault others, and so on. 
The governmental agency may codify its controlling practices and 
maintain the contingencies thus set forth, but it seldom attempts to 
make the code effective in any other way. Tlie individual is directly 
affected by only a small fraction of prevailing contingencies. In 
asserting that “ignorance of the law is no excuse,” the governmental 
agency leaves the actual conditioning of the individual to others. 
Parents and friends establish minor contingencies which keep be¬ 
havior within legal bounds, and the governmental function may also 
be actively supported by the ethical group and by religious and educa¬ 
tional institutions with their appropriate techniques. 

The governmental agency often conceals its neglect of this impor¬ 
tant step in control by claiming to have an educational effect. The 
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incliviclual is said to be affected by witnessing the punishment of 
others. But the effect of punishment as a deterrent to those who are 
not themselves punished is neither simple nor inevitable. The ques¬ 
tion is not peculiar to governmental contingencies. A boy may see a 
companion fall from a tree and may then see that the companion 
behaves in a manner characteristic of strong aversive stimulation. 
'Ihrough at least two stages of respondent conditioning any subse¬ 
quent move on the part of the boy himself to climb trees generates 
conditioned aversive stimulation, a reduction in which reinforces 
competing behavior. The process is the same, although the effect is 
not of the same magnitude, as when the boy himself falls and is hurt. 
'I’hc same aversive stimulation—from trees and from boys in trees— 
explains why the boy may stop others who start to climb trees and 
why he may call climbing trees "wrong” or "bad.” In the same way a 
man who has obsersed illegal behavior and the punishment contin¬ 
gent upon it mav act to keep himself from such behavior and to 
prevent others from behaving in the same way. In doing so, he sup¬ 
ports governmental control. But it is rare that an individual witnesses 
both the behavior and the punishment of another person. The effect 
of the contingency expressed in a law is usually mediated by complex 
verbal processes, which cannot be fully analyzed here. The law itself 
is a verbal device, and it is in furthering these intermediate processes 
that codification of governmental practices helps most. A code sup¬ 
ports the verbal behavior which bridges the gap between instances 
of punishment and the behavior of others. Nevertheless, it is only a 
slight step toward a recognition of the behavioral processes through 
which governmental control is usually exerted. 

The effect of a law upon the controlling agency. The government 
of a large group requires an elaborate organization, the practices of 
which may be made more consistent and effective by codification. 
How codes of law affect governmental agents is the principal subject 
of jurisprudence. The behavioral processes are complex, although pre¬ 
sumably not novel. In order to maintain or "enforce” contingencies 
of governmental control, an agency must establish the fact that an 
individual has behaved illegally and must interpret a code to deter¬ 
mine the punishment. It must then carry out the punishment. Tliese 
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labors are usually divided among special subdivisions of the agency. 
T he advantages gained when the individual is “not under man but 
under law” have usually been obvious, and the great codifiers of law 
occupy places of honor in the history of civilization. Codification docs 
not, however, change the essential nature of governmental action nor 
remedy all its defects. 

TRADITIONAL IN I’ERPRETATIONS 

Until fairly recently it was customar)' to accept a mode of govern¬ 
ment, and the law which embodied it, as derived from unquestion¬ 
able authority and permanently fixed. In the Divine Law of the Mid¬ 
dle Ages, “legal” and “illegal” were held to be immutable classifica¬ 
tions laid down by absolute decree. Such a view was strengthened by 
the absence of historical and comparative facts regarding other gov¬ 
ernmental and legal practices, and it was probably to some extent 
encouraged by the very codification of law. But the inevitable conse¬ 
quence was that any analysis of human behavior had to adjust itself 
to a particular set of established practices. Behavior had to be ac¬ 
cepted, not for what it was obsen^ed to be, but for what it was decreed 
to be. If there was any discrepancy between the two, conformity to the 
decree prevailed. 

The modern view, which is of surprisingly recent date, accepts the 
fact that government and law depend upon the circumstances of a 
given culture or epoch. It recognizes the fact that there is an English 
law, a French law, a Chinese law, a law of the sixteenth century, a 
law of the twentieth century, and so on. The modem lawmaker and 
the modem jurist are more likely to interpret governmental and legal 
practices in terms of their current effects upon the individual and the 
state. As a result of this change the obser\'ation of human behavior 
is no longer bound by authoritarian pronouncements, and a scientific 
study is under no obligation to justify a given set of practices. There 
remains, however, a great discrepancy between legal and scientific 
conceptions of human behavior. 

In the tradition which led to modem English and American law, 
man was regarded as a “responsible” creature, who was bom with or 
quickly acquired a “knowledge of right and wrong.” He was held to 
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be “accountable” for his actions, and if he violated a law, it was con¬ 
sidered just that he be punished. Punishment was explained in differ¬ 
ent ways, depending upon the source of power of the government. 
\\ lien the power was derived from the strength of the governor or 
was asserted to be of divine or other absolute origin, a crime was 
regarded as an offense against the state. Punishment of the offender 
"vindicated” the state. This interpretation appears to be a rationaliza¬ 
tion of emotional dispositions on the part of governors to act aggres- 
si\ ely toward those who “disturb the peace” or otherwise threaten 
their power. When the power was derived, at least in part, from the 
governed, the state was said to act in the interest of the more imme¬ 
diately aggrieved. Its function was then to “even a score,” and the 
problem of penolog)' was to make the punishment fit the crime. Jus¬ 
tice had been done when the aversive stimulation received by the 
criminal precisely matched that of the aggrieved member of the 
group: an eye for an eye and a tooth for a tooth. This interpretation 
also seems to be related to an emotional tendency to take revenge. 

Another interpretation of punishment appeals to constructive be¬ 
havioral processes: It is said that a man is punished so that he will be 
less likely to misbehave in the future and so that others will be de¬ 
terred from similar misbehavior. Tliis effect may have nothing to do 
with emotional dispositions on the part of an offended ruler or an 
aggrieved citizen. At the same time, it is not appropriate to a con¬ 
ception of man as a responsible free agent with a knowledge of right 
and wrong. The difficulty is currently evident in conflicting theories 
of penology. It is now generally recognized that punishment is in¬ 
effective simply as a means of making behavior less probable. To take 
advantage of a better understanding of the process requires a change 
of practice, but this is difficult in the faee of traditional views of 
human nature which presuppose another result. We may restate gov¬ 
ernmental and legal practices, however, in a way which is consistent 
with the behavioral processes involved in punishment. 

As we saw in Chapter VII, operant behavior is closely associated 
with “volition.” A “deliberate act,” undertaken to obtain a “desired 
end,” is an operant. The traditional way of describing it is unfortunate 
because it emphasizes a future event which can have no contemporary 
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effect. It is necessary to endow the individual with a “knowledge of 
consequences” or some sort of “expectation” to bridge the gap be¬ 
tween the past and the future. But we are always dealing with a prior 
histor)' of reinforcement and punishment. The practices of govern¬ 
ment and law arc clearly designed to construct or supplement such 
histories, and we can describe the individual who has come under 


governmental control wholly in such terms. T he reasons or 
"grounds" for an "end-seeking action” arc simply some of the vari¬ 
ables of which behavior is a function. "Deliberation" and "desire" 


are others. A history of punishment is still another. To say that a 
person is "held responsible" for an act is simply to say that he is 


usually punished for it. 

The question of the death penalty for murder supplies an example 
of the necessary change in interpretation. There is little doubt that 
death is an effective way of reducing a probability of response, but if 
capital punishment is simply a way of removing a dangerous indi¬ 
vidual from society, it has only an economic advantage over life 
imprisonment, which might be preferred for other reasons. Whether 
the execution of a murderer is a deterrent to others could presumably 


be decided with available techniques. It has often been pointed out 
that when pickpockets were hanged publicly, the crowds which 
gathered to witness the hangings proved to be easy marks for pick¬ 
pockets, although it is difficult to conceive of circumstances under 
which the death penalty should be a more effective deterrent. Any 
decision concerning capital punishment appears to be a practical 
one, involving the weighing of advantages and disadvantages to 
society. But if the decision is to eliminate the death penalty, it may 
be opposed by those to whom punishment is a forni of retribution 
and who may argue that in order to “equal the score” or “maximize 

justice” one who has killed must be killed. 

A similar conflict arises in other forms of punishment. Is imprison¬ 
ment a form of aversive stimulation or an opportunity to re-educate 
the individual? The fixing in advance of a given period of imprison¬ 
ment presupposes the former, since the time needed for re-education 
is not necessarily closely related to the nature of a crime or to its 
magnitude. Any attempt to adopt practices which presuppose the 
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latter may be opposed by those to whom punishment is a form of 
revenge. 

'I'he same transitional stage is evident in other discussions of 
responsibilitv. In current practice a murderer who is judged insane 
docs not receive the death penalty; he is merely incarcerated to 
prcN cnt further criminal behavior. The traditional view is that since 
lie is not “responsible,” it is not “just” that he be killed. But the same 
practice may be defended more consistently in terms of controllabil- 
itv. We cannot deter the insane or correct their behavior because 
they arc by definition out of control. Physical restraint is the only 
available technique and may be frankly adopted for this reason. 
Lesser degrees of “irresponsibility” prove upon analysis to be simply 
lesser degrees of “uncontrollability.” When it can be demonstrated 
bv adequate testimony that a man is incapable of changing his con¬ 
duct as the result of repeated legal punishment, he is permanently 
incarcerated. We do not commonly regard this as retribution; in¬ 
carceration is required because other governmental techniques have 
failed. Sometimes psychotherapy, rather than legal punishment, is 
recognized as appropriate. 

Hie responsibility of even the normal or legally sane citizen is 
acknowledged to have certain limits. Tliis is again the question of the 
effectiveness of governmental controls. Illegal behavior is sometimes 
not punished, or is punished less severely, because it is committed in 
“the heat of passion,” or in obeying an “irresistible impulse,” or 
“under extenuating circumstances.” In the traditional view the indi¬ 
vidual is not held responsible for his actions under such circum¬ 
stances. In the present terms we may simply say that certain tech¬ 
niques of governmental control are recognized to be ineffective in 
competition with strong emotional or motivational variables. There 
is no point in attempting to apply governmental control, other than 
incarceration, to the behavior to which these variables lead. When 
such circumstances are not likely to occur frequently, the individual 
is permitted to remain at large. A philosophy of retribution, on the 
other hand, would still demand that justice be done. 
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OTHER TYPES OF GOVERNMENI’AL CONTROL 

It is not only the weight of tradition which is responsible for cur¬ 
rent inconsistencies in our philosophies of go\crnmcnt and law. 1 he 
ultimate weakness of punishment as a technique of control has been 
known for a long time. Unfortunately, alternative techniques require 
a different kind of governmental power and a better understanding 
of human behavior. Ethical control by the group has moved only 
ver\' slowly from coercive techniques, in which the individual is forced 
to behave in conformitv with the interests of others, to techniques 
in which “good” is more important than “bad.” Religious agencies 
have, as we shall see, moved only slowly from an emphasis upon the 
punishments of Hell and the anger of jealous gods to the positive 
inducements of Heaven or the present satisfactions of the good life. 
Since governmental agencies have been particularly committed to tbe 
use of punishment, the change to other forms of control has been 

especially slow. 

Modern governments, however, have it in their power to use other 
techniques and do so extensively. If wealth is accumulated—through 
taxation, for example—economic control is then available (Chapter 
XXV). This is used as a form of positive reinforcement in subsidies 
and bonuses. Tlic citizen is thus induced to act legally rather than de¬ 
terred from acting illegally. Although it is theoretically possible to 
control agricultural production through punishment by making the 
cultivation of certain crops illegal, a government with economic 
power achieves the same effect through positive reinforcement with 
subsidies. Tire educational control of legal behavior is another alterna¬ 
tive technique. Where it is theoretically possible to induce a soldier 
to fight entirely through coercion—by arranging matters so that he 
must fight or be still more severely punished than in battle—a modern 
government is likely to generate an inclination to fight through edu¬ 
cational devices. Variables in the fields of respondent conditioning, 
motivation, and emotion are arranged to increase a disposition to 
fight. Tliese practices lead eventually to far more effective behavior 
than coercion. Unfortunately, educational techniques in the field of 
government are represented most conspicuously by propaganda, 
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where variables are manipulated for an effect which is concealed or 
disguised, often in a way which is aversive to many people. But edu¬ 
cation may be effective even when the result is clearly indicated. 

Similar alternative techniques are available in preventing illegal 
behavior, but the processes are more complicated and are not yet 
well explored. A start has been made at the level of minor offenses. 
Motorists are usually induced to obey traffic signals by a familiar 
process. A certain percentage of those who go through stop signs, for 
example, are punished. An alternative procedure which has been tried 
successfully is to commend or otherw'ise reinforce motorists who 
obey signs. This is clearly not an adequate technique for all drivers, 
but it has a measurable effect upon many who might otherwise be 
only partially controlled by traffic signals. Educational programs 
which point up the contingencies behveen reckless driving and its 
consequences—injur)' or death—should in the long run be more 
effective than a program of arrests and fines. 

When a governmental agency turns to auxiliary techniques which 
arc not based upon punishment, the concept of man as a *‘respon- 
sible agent” falls into disuse. This is additional proof that the concept 
serves merely to rationalize the use of punishment as a technique of 
control. 

COUNTERCONTROL OF 
GOVERNMENTAL AGENCIES 

Government and governed compose a social system in the sense of 
Chapter XIX. The questions which have just been raised concern the 
reciprocal interchange between the participants. The government 
manipulates variables which alter the behavior of the governed and is 
defined in terms of its power to do so. The change in the behavior 
of the governed supplies a return reinforcement to the government 
which explains its continuing function. A given system may be as 
simple as a strong man taking property from the weaker members of 
a group or as complex as a modern government embarking upon an 
educational program which will generate the skilled manpower it 
needs. 

Such a system is inherently unstable, again in the sense of Chapter 
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XIX, since the power of the agency increases with each interchange. 
In fact, the growth of power accelerates as control becomes more and 
more effective. Other things being equal, governments grow stronger 
in the act of governing, \\4icn the strong man coerces others to 
engage in control in his interest, his total power is increased. When 
a government uses force to acquire wealth, it can then also exercise 

economic control. 

The process cannot go on indefinitely, however. One limit, which 
arises within the system itself, is the simple exhaustion of the re¬ 
sources of the governed. This is exemplified in the ultimate failure 
of the tyrannical exploitation of a people. Excessive control also 
generates behavior on the part of the controllee in the form of escape, 
revolt, or passive resistance, as wc shall sec in Chapter XXIV. Other 
limits may be imposed from outside the system through competition 

with other would-be governing agencies. 

Tlie codification of controlling practices often has the effect of 
stabilizing the system. In stating a contingency between behavior 
and punishment, for example, a law imposes a restriction upon the 
governing agency. Tlie social system of government and governed 
cannot deteriorate appreciably unless the law is changed. A more 
explicit countercontrol is represented by a constitution, in which a 
government which deri\'es its power from the consent of the gov¬ 
erned is constrained to use that power within specified areas. A con¬ 
stitution may specify the composition of the governing agency, the 
channels through which it receives its power, and the procedures 
according to which laws are to be made, interpreted, and enforced. 
With these specifications the system is prevented from deteriorating 

through an asymmetrical interchange. 

A nation which has been completely defeated in warfare may, for 
a time at least, be governed by its conquerors. No constitution speci¬ 
fies the kinds or limits of power to be wielded. So far as immediate 
power is concerned, there is nothing to prevent the mass slaughter of 
the whole population, a practice of which history supplies many 
examples. But even when governmental power is not derived from the 
consent of the governed, it is now recognized that a government is 
not strengthened by excessive exploitation of a people. Mass murder 
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is obviously not an effectise way to use the human resources of the 
conquered countr)-. The practice also generates extreme measures of 
countercontrol on the part of other countries in danger of a similar 
fate, and it plunges the government into serious trouble in controlling 
its own citizens. 

\Vc shall consider other undesirable by products of excessive con¬ 
trol in Chapter XXIV. 

JUSTIFICATION OF 
COVERNMENI AL PRACTICES 

Governments have traditionally been evaluated in terms of their 
effects in promoting several principles. We have seen that one of 
these—justice—is appropriate to the narrower definition of govern¬ 
ment as the power to punish. It is punishment which is adminis¬ 
tered with justice, and a government which is successful in balancing 
aversive consequences is said to “maximize justice.” Our practical 
support of such a government is probably not due to any such prin¬ 
ciple, however, but rather to the fact that a just government, in com¬ 
parison with other governments, is more likely to reinforce the 
behavior of supporting it. 

Another principle commonly appealed to is freedom. That gov¬ 
ernment is said to be best which governs least. The freedom which is 
maximized by a good government is not, however, the freedom which 
is at issue in a science of behavior. Under a government which con¬ 
trols through positive reinforcement the citizen feels free, though 
he is no less controlled. Freedom from government is freedom from 
aversive consequences. We choose a form of government which maxi¬ 
mizes freedom for a very simple reason: aversive events are aversive. 
A government which makes the least use of its power to punish is 
most likely to reinforce our behavior in supporting it. 

Another principle currently in fashion is security. Security against 
aversive governmental control raises the same issue as freedom. So 
does security from want, which means security from aversive events 
which are not specifically arranged by the governing agency—from 
Jiunger, cold, or hardship in general, particularly in illness or old age. 
A government increases security by arranging an environment in 
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which many common aversive consequences do not occur, in which 
positive consequences are easily achieved, and in whicli extreme 
states of deprivation are avoided. Such a government naturally rein¬ 


forces the behavior of supporting it. 

The “riglit” of a ruler was an ancient device for explaining his 
power to rule, ‘'numan rights” such as justice, freedom, and security 
arc devices for explaining the countercontrol exercised by the gov¬ 
erned. A man has his rights in the sense that the governing agency is 
restricted in its power to control him. He asserts these rights along 


with other citizens wlien he resists control. 


“Human rights” arc ways 


of representing certain effects of governing practices—effects which 
arc in general positively reinforcing and which we therefore call good. 
To "justify” a government in such terms is simply an indirect way of 
pointing to the effect of the government in reinforcing the behav ior 


of the supporting group. 

It is commonly believed that justice, freedom, security, and so on 
refer to certain more remote consequences in terms of which a form 


of government may be evaluated. We shall return to this point in 
Section VI, where we shall see that an additional principle is needed 
to explain why these principles are chosen as a basis for evaluation. 



RELIGION 


We have no reason to be disturbed by the fact that the 
basic practice through which an efficient government “keeps the 
peace” is exemplified under far less admirable circumstances in the 
use which the bully or gangster makes of his power to punish. It is 
not the technique of control but the ultimate effect upon the group 
which leads us to approve or disapprove of any practice. There is a 
similar discrepancy between the kinds of uses to which the basic 
technique of religious control may be put. TTie place of religion in 
modern life cannot be clearly understood without considering cer¬ 
tain processes which are employed outside the field of religion proper 
for very different purposes. 

Usually such terms as “superstition” and “magic” are aversive 
because they are commonly associated with exploitation for selfish 
purposes or with ineffective or poorly organized behavior. There is, 
however, no absolute distinction between a superstitious and a non- 
superstitious response. In respondent conditioning we saw that a 
single pairing of stimuli could result in a conditioned reflex. A neu¬ 
tral stimulus which has merely happened to accompany a fearful 
event may subsequently evoke an emotional response, and the effect 
may survive for a long time in spite of repeated presentations of the 
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neutral stimulus alone. In operant behavior a single instance of a 
response wliich is followed by a reinforcing event may be strength¬ 
ening, and the effect may simivc for a long time even though the 
same consequence never occurs again. \'^crbal behavior is especially 
likely to show this sort of “magic” because of the lack of a mechan¬ 
ical connection between response and reinforcement. Tlie child 
acquires an elaborate verbal repertoire which produces certain effects. 
Through the process of induction he also exhibits verbal responses 
which cannot have more than an occasional accidental effect. 
Having successfully told people to stop, he may cry “Stop!” to a ball 
rolling out of reach. Though we may prove that his response can have 
no effect upon the ball, it is in the nature of the behavioral process 
that the response nevertheless acquires strength. As \vc have already 
seen, the tendency to behave superstitiously necessarily increases as 
the individual comes to be more sensitively affected by single con¬ 
tingencies. Between the contingency which is obser\'ed only once in 
the life of the individual and the contingency which is inevitably 
observed there is a continuum which we cannot divide sharply at any 
point to distinguish between “superstition” and “fact.” 

A prototype of religious control arises when rare or accidental con¬ 
tingencies are used in controlling the behavior of others. For example, 
we may “blame” someone for an unfortunate event which was not 
actually the result of his behavior, although the temporal relation 
was such that a contingency can be asserted. “If you hadn't dawdled 
so, we should have started earlier, and the accident never would have 
happened.” We blame him in order to alter his future behavior—to 
make him less likely to dawdle, and we achieve this by converting an 
unrelated event into an effective punishing consequence through 
certain verbal processes. We use the event as a punishment, even 
though we did not actually arrange the contingency. It is only a 
short step to claiming the ability to arrange such contingencies. This 
is the underlying principle of witchcraft. Unless the controllee be¬ 
haves according to command, the controller will bring bad luck to 
him. The threat to do so may be as powerful as the infliction of 

comparable physical punishment. i • r 

We also affect the behavior of others by using accidental reinforc- 
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ing consequences of a positive sort. “You see, if you hadn t followed 
iny advice, you would have missed this pleasant surprise." It is only 
a short step to the claim to be able to mediate future positive rein¬ 
forcements—to be able to “bring good luck.’’ Tire claim may be used 
to induce another person to grant favors, to pay money, and so on. 
Thus, to sell a spurious device for locating water underground it is 
only necessary to establish the claim that by using the device the 
well-digger will be reinforced by finding water. Good-luck charms 
have economic value when their power to mediate positive reinforce¬ 
ment is made convincing to the buyer. 

Perhaps it is a far cry from these selfish practices to those of the 
organized religious agency, but the same techniques appear to be 
exemplified. The control which defines a religious agency in the 
narrowest possible sense derives from a claimed connection with the 
supernatural, through which the agency arranges or alters certain 
contingencies involving good or bad luck in the immediate future or 
eternal blessedness or damnation in the life to come. Such a control¬ 
ling agency is composed of those who are able to establish their claim 
to the power to inter\’ene supematurally. The agency may consist of 
a single individual, such as the tribal medicine man, who resorts to 
demonstrations of magic to prove his power to bring good luck or 
bad, or of a well-organized church with documented proof that the 
power to intervene in the arrangement of reinforcing contingencies 
has been vested in it by supernatural authority. We are concerned 
here, not with the actual structure of the agency nor with the inter¬ 
nal techniques of control which make it an effective instrument, but 
with the practices through which it controls the members of the 
group. 


TECHNIQUES OF RELIGIOUS CONTROL 

The principal technique is an extension of group and governmen¬ 
tal control. Behavior is classified, not simply as “good" and “bad” or 
“legal” and “illegal,” but as “moral” and “immoral” or “virtuous” 
and “sinful.” It is then reinforced or punished accordingly. Tradi¬ 
tional descriptions of Heaven and Hell epitomize positive and nega- 
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tive reinforcement. The features vary from culture to culture, but it 
is doubtful whether any well-known positive or negative reinforcer 
has not been used. To a primitive people who depend upon forest 
and field for their food. Heaven is a happy hunting ground. To a 
poverty-stricken people primarily concerned with the source of the 
next meal, it is a perpetual fish fr\-. To the unhappy it is relief from 
pain and sorrow or a reunion witii departed friends and loved ones. 
Hell, on the other hand, is an assemblage of aversive stimuli, which 
has often been imaginatively portrayed. In Dante’s Inferno, for 
example, we find most of the negative reinforcers characteristic of 
social and nonsocial environments. Only the electric shock of the 


psychological laboratory is missing. 

The reinforcers portrayed in Heaven and Hell arc far more power¬ 
ful than those which support tlie “good" and “bad of the ethical 
group or the “legal" and “illegal” of governmental control, but this 
advantage is offset to some extent by the fact that they do not actu¬ 
ally operate in the lifetime of the individual. The power achieved by 
the religious agency depends upon how effectively certain verbal rein¬ 
forcements are conditioned-in particular the promise of Heaven and 
the threat of Hell. Religious education contributes to this power by 
pairing these terms with various conditioned and unconditioned 
reinforcers which are essentially those available to the ethical group 
and to governmental agencies. The relation between the agency and 
the communicant, or between God and man. is often made more 
effective by being characterized as such a familiar mundane relation 
as that between a father and his sons, a king and his subjects, or a 
militarx^ commander and his men-where again the primary rein¬ 
forcing contingencies do not differ greatly from those used in ethical 

and governmental control. 

In actual practice a threat to bar from Heaven or to consign to 
Hell is made eontingent upon sinful behavior, while virtuous bdrav- 
ior brings a promise of Heaven or a release from the threat of Hell. 
The last is a particularly powerful technique. Tire agency punishes 
sinful behavior in such a way that it automatically generates an 
aversir e condition which the individual deseribes as a “sense of sm 
The agency then provides escape from this aversive condition through 
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expiation or absolution and is thus able to supply a powerful rein¬ 
forcement for pious behavior. 

Other techniques are, of course, encountered in religious control. 
Insofar as the agency controls other variables, it can use other proc¬ 
esses. It may acquire wealth and operate eventually through economic 
control (Chapter XXV). It may train and support teachers to achieve 
educational control (Chapter XXVI). It may utilize ethical or gov¬ 
ernmental techniques in addition to those within its own sphere 
(Chapters XXI and XXII). This is especially likely when its control¬ 
ling practices coincide with those of the group as a whole. In short, all 
the techniques described under self-control in Chapter XV and under 
personal control in Chapter XX are available to the agency possessing 
the ncccssar)' power. 

The use of physical restraint by a religious agency is exemplified by 
actual incarceration, as in the treatment of women in Moslem coun¬ 
tries. Relevant environmental conditions are manipulated when the 
stimuli which elicit or set the occasion for sinful behavior are weak¬ 
ened or removed and when the stimuli which elicit or serse as the 
occasion for virtuous behavior are pointed up. Suggested regimens of 
simple fare, unseductive clothing, limited personal contact, and the 
other features of the cloister or the “sheltered life” follow this pat¬ 
tern. Religious agencies are likely to favor censorship of movies, 
plays, and books, the enforcement of laws governing modesty of 
dress, the prohibition of the sale of alcoholic beverages, and so on, 
because these measures reduce occasions for sinful behavior. Satia¬ 
tion and deprivation also are manipulated. St. Paul defended mar¬ 
riage as a measure which reduces licentious behavior, and periods of 
fasting and regimens of exercise may be employed for the same 
effect. Ritualistic techniques which affect the physiology of the 
organism are common—in Hindu practices, for example. Some reli¬ 
gions encourage substitute forms of behavior to reduce sexual or 
other tendencies; the practice is based upon the transferred satiation 
discussed in Chapter IX. Since emotion is usually an important means 
of religious control, respondent conditioning is important. Religious 
art, music, and pageantry generate emotional responses by portraying 
the suffering of martyrs, the torments of the damned, the tender 
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emotions of tl,c family, and so on. These responses arc transferred to 
stimuli, verbal or nonrerbal, which are later used by the agency for 
purposes of control. Some religious agencies resort to the use ot 
drugs, cither to induce appropriate emotional or motivational con- 
ditiLs or to produce effects which seem to support the claim of a 

supernatural connection. 

other kinds of religious agencies. Many religious agencies make no 
claim to be able to intersene in the arrangement of reinforcements. 
The agency may accept the existence of supernatural reinforcing 
events-for example. Heaven and Hell-but may claim only to be 
able to prescribe a course of action upon which they are con mg i 
Tire attainment of Heaven or Hell is said to depend upon the behav¬ 
ior of the individual alone. The agency controls the communicant, 
not by manipulating contingencies of reinforcement, but by making 
certain real or claimed contingencies more effective. Its techniques 
then resemble those of the counselor (Chapter XXIV) or teacher 
(Chapter XXVI). Such an agency is composed of those who es a 
their Lim to the knowledge of such a way of life and who exercise 

that claim for purposes of control. 

still other religious agencies make no appeal to supernatural events 

whatsoever Their techniques are scarcely to be distinguished from 

those of the ethical group. The agency simply ° 

in encouraging good behavior and discouraging bad. It functions 
counselor or teacher in demonstrating certain contingencies between 
-good- or -bad- behavior and natural consequences^ A '^y of h e is 
set forth which “brings its own reward.” Membership m this third 

type of agency is often not sharply defined. 

THE BEHAVIOR CONTROLLED BY 
THE RELIGIOUS AGENCY 

Tire behavior which comes under religious control depends upon 
the tvpe of agency. For the medicine man, who uses h.s magic for his 
aaarandizement “pious” behavior is simply any behavior which 
reTnforees him On’the other hand, the well-developed religious 
agency which derives much of its power from the group may contro 
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largely in accordance with group practice. It works in concert with 
ethical control in suppressing selfish, primarily reinforced behavior 
and in strengthening behavior which works to the advantage of 
otlicrs. The control is usually much more stringent, however, than 
that exercised by the group. Variables are manipulated in ethical 
control because of some current threat to the welfare of a member 
of the group, but the religious agency maintains its practices accord¬ 
ing to more enduring criteria of sirtiious and sinful behavior. Where 
eating and drinking may be restricted by ethical reinforcement only 
when tlicv work to the momentary^ disadvantage of others, religious 
control may establish much narrower limits by classifying gluttony 
as a deadly sin and temperance as a cardinal virtue. Where sexual 
behavior is controlled by the group mainly in certain competitive 
situations, the religious agency may encourage chastity and celibacy 
as a general program and may tolerate sexual behavior even in mar¬ 
riage only for the purpose of procreation. Acquisitive or possessive 
behavior which leads to group retribution only in a competitive situa¬ 
tion and is elsewhere classified as good may be wholly suppressed, 
regardless of the circumstances, by the religious agency which de¬ 
mands a vow of poverty or enjoins the communicant not to lay up 
treasures on earth. The boastful behavior of the Pharisee, which 
encounters only moderate group censure, is suppressed in favor of 
humility and modesty. The extremity of this form of religious control 
is seen in the suppression of the behavior of self-presenation in 
pacifistic philosophies, acts of martyrdom, and the mortification of 
the flesh. On the other hand, behavior which benefits others is pro¬ 
moted. Love or charity as a disposition to favor others is encouraged, 
and the communicant is reminded that he is his brother’s keeper and 
must give all that he has to the poor. 

The religious agency usually establishes a repertoire of obedience 
for future use, and it may also set up extremely powerful self-control 
to guarantee a measure of controlled behavior in the absence of the 
religious agent. The latter is one of the consequences of an emphasis 
on punishment. Because the control is often exerted more power¬ 
fully than by the group, the religious conscience or superego often 
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speaks in a louder voice than the ethical. Extreme measures of self- 
restraint are sometimes enjoined. The individual may confine himself 
to restricted diets, enter upon periods of fasting, engage in certain 
exercises or adopt certain postures, or take certain drugs—all because 
of the resulting change in his dispositions to act in virtuous or sinful 
ways. Self-control through the manipulation of stimuli is common. 
“Temptation” (often personified in religious literature as Satan) 
embraces all the stimuli which lead to sinful behavior. “Wrestling 
with the devil” appears to describe the conflict between the con¬ 
trolled and controlling responses of Chapter XV. 

EXPCMNING THE AGENCY 

The controlling relations which hold the religious agency together 
as an effective unit do not account for the ultimate form of control, 
nor would they explain the agency which has only one member. To 
account for the existence and maintenance of the agency as a whole 
we turn to external variables. If the agency serves the group by extend¬ 
ing ethical control, the agency may be explained by the support 
which the group gives it. The religious agent may be paid by the 
group, he may be disposed to control because the group approves 
this as “right " or he may be coerced into working for the agency 
because any other course of aetion would be punished as “wrong.” 

There is another possible interpretation of the behavior of some 
religious agents. When an individual is conditioned through ethical 
and religious practices to “avoid temptation”-to ehrnmate stimuli 
which would otherwise be conducive to wrong or sinful behavior 
his efforts may be so extensive that they affect other people as we 1 
Freud called the result “reaction formation. If the individual s 
behavior in this respect resembles religious control, he may sirnply 
join the agency. He is reinforced for serving as a religious agent by 
the effect upon his own behavior. If economic or coercive control 
appears to be unimportant, his zeal may be unusually conspicuous^ 
sLce this explanation presupposes that the religious agent himsel 
has an especially high probability of engaging in sinful behavior, it is 

generally resisted. 



358 


CONTROLLING AGENCIES 


COUNTERCONTROL 

An agency always operates within certain limits. The religious 
agency may come into conflict with other religious agencies attempt¬ 
ing to control the same people or with governmental agencies with 
different programs of control. Religious control is often opposed by 
economic and educational agencies and, as we shall see in Chapter 
XXIV, by psychotherapy. 

Another limit is internal. It is imposed by the extent to which the 
controilcc will submit to control. The claim to supernatural interces¬ 
sion supplies a powerful technique. Religious agencies, like all other 
agencies here being considered, have sometimes used their power for 
personal or institutional advantages—to build organizations, to accu¬ 
mulate wealth, to punish those who do not come under control 
easily, and so on. From time to time this has given rise to measures 
of countercontrol which have restricted the scope of the agency. The 
religious controllee may simply leave the sphere of control of the 
agency, he may question the reality of claimed contingencies, he may 
attack the agency by establishing a rival agency, and so on. 

JUSTIFICATION OF RELIGIOUS CONTROL 

The justification of religious practice is an important part of 
theology. A particular practice may be recommended because it 
maximizes some such entity as salvation or the glory of God. Such 
justifications are presumably beyond the realm of science. An analysis 
of techniques permits us to account for the behavior of both con¬ 
troller and controllee without raising the question of any ultimate 
effect of this sort. When a religious practice does not appeal to super¬ 
natural events, its traditional justification resembles that of ethical 
control; a religious practice is supported because it maximizes piety 
or virtue. These entities have a function in the field of religion simi¬ 
lar to that of the greatest good of the greatest number in ethics, and 
freedom or justice in government. They are “principles” in terms of 
which we choose or suggest a given practice. Whether a science of 
behavior provides us with any basis for explaining why we choose or 
suggest such a principle will be considered in Section VI. 
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CERTAIN BY-PRODUCTS OF CONTROL 

The control exercised by the group and by religious and govern¬ 
mental agencies, as well as by parents, employers, associates and so 
on, restricts the selfish, primarily reinforced behavior of the indi¬ 
vidual. It is exercised for just that reason. Certain by-products, how¬ 
ever. are not to the advantage of the controller and are often harrnful 
both to the individual and to the group. These are especially likely 
to be encountered when the control is excessive or ineonsistent. 


Escape. The individual may simply run away from the controller. 
Tire hermit escapes from the control of the ethical group by physi¬ 
cally withdrawing from it, as the boy runs away from home; but the 
controllee may be “withdrawn” without being actually separated, 
Escrpe from religious control is represented by disbelief and defec¬ 
tion, and from various forms of governmental control by desertion, 
evasion, renunciation of citizenship, and breaking jail. 


Revolt. The individual may counterattack the eontrolling age^. 
He may respond to criticism from the group by criticizing it m turn, 
Z Tberal accuses the group of being reactionary, the libertine 
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accuses it of being prudish. Vandalism is a more eonerete example 
of eounteraggression—toward the group as a whole or toward a spe¬ 
cific subgroup, as in the willful destruction of school property. Reli¬ 
gious revolt may be directed toward a specific agency, as in protestant 
reform, or against the theological system used in control, as in athe¬ 
ism. Rc\olt against governmental control is exemplified, not only by 
political resolution, but, when the structure of the group permits, by 
impeachment or a vote of no confidence. 


Passive resistance. Another result, far less easily described, consists 
of simplv not behaving in conformity with controlling practices. Tliis 
often follows when the individual has been extinguished in efforts to 
escape or revolt. 'I’he behavior is epitomized by the mule which fails 
to respond to the asersivc stimulation of the whip. The child, unsuc¬ 
cessful in avoiding or revolting against parental control, simply 
becomes stid)born. The employee, unable to escape (by resigning) 
or to revolt in vandalism or other acts of violence, simply “slows 
down.” “sits down,” or “strikes.” Thoreau’s civil disobedience, prac¬ 
ticed perhaps most conspicuously by Gandhi, is the parallel reaction 
to governmental control. 

The controlling agency usually deals with these by-products by 
intensifying its practices. The escapee is captured and confined more 
securely. The revolt is put down, and the revolutionist shot. The 
apostate is excommunicated. A fire is built under the mule, and 
1 horcau is jailed. Hie agency may also meet this problem by pre¬ 
paring the individual in advance to control his own tendencies to 
escape, revolt, or strike. It classifies these types of behavior as wrong, 
illegal, or sinful, and punishes accordingly. As a result any tendency 
on the part of the individual to escape, revolt, or strike generates 
aversive self-stimulation, a reduction in which may reinforce behav¬ 
ior acceptable to the agency. But in the long run the problem cannot 
be solved in this way. Intensification of control may simply multiply 
the difficulties. Physical restraint or death may effectively eliminate 
behavior, but the individual is no longer useful to the group. Re¬ 
straint is unsuccessful in controlling the covert behavior in which 
the individual may plan escape or revolt. Restraint also cannot con¬ 
trol many sorts of emotional reactions. Techniques designed to gen- 
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crate additional sd/-control of emotional behavior are, as we have 
seen, especially inadequate. 

'I’he by products of control which incapacitate the individual or 
are dangerous cither to the individual or to others are the special 
field of psychotherapy. Wc shall discuss this as a kind of controlling 
agency. Among the kinds of behavior which it treats we may distin¬ 
guish certain effects primarily in the field of emotion and others in 

operant behavior. 

EM07 I0NAL BY PRODUC I'S OF CONTROL 

Fear. The controlling practice which leads the individual to escape 
also gives rise to the emotional pattern of fear. Reflex responses in 
glands and smooth muscles are first elicited by the aversive stimuli 
used in punishment and later by any stimuli which have occurred at 
the same time. These responses may be accompanied by a profound 
change in operant behavior—an increase in the strength of any 
behavior which has led to escape and a general weakening of other 
forms The individual shows little interest in food, sex, or practical 
or artistic enterprises, and in the extreme case he may be essentially 

“paralyzed by fear.” 

When the stimuli which have this effect are supplied by the pun¬ 
ishing agent, the individual suffers from an excessive fear of his 
father, the police, God, and so on. When they arise from the occa¬ 
sion upon which punished behavior has occurred, the individual is 
afraid of such occasions. Thus if he has been punished for sexual 
behavior, he may become unduly afraid of anything which has to do 
with sex- if he has been punished for being unelean, he may become 
unduly afraid of filth; and so on. When the stimuli are generated by 
the punished behavior itself, the individual is afraid to act—he is as 
we say afraid of himself. It is often difficult, for either the individual 
himself or anyone else, to identify' the stimulation responsible for 
the emotional pattern. If the eondition recurs frequently, as is espe- 
cially likely to be the case with self-generated stimuli, the fear may 

become chronic. 

The phobias represent excessive fear reactions to circumstances 
which are not always clearly associated with control. But the fact that 
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tliey arc “unreasonable” fears—fears for which no commensurate 
causal condition can be found—suggests that they are primarily 
responses to punishment and that the fear generated by excessive 
control has simply been displaced (Chapter X). 

Anxiety. A common accompaniment of avoidance or escape is 
anxiety. As we saw in Chapter XI, fear of a future event may be 
aroused by specific stimuli which have preceded punishing events or 
bv features of the general environment in which such events have oc¬ 
curred. Anxiety may vary in intensity from a slight worry to extreme 
dread. The condition includes both responses of glands and smooth 
muscles and marked changes in operant behavior. We imply that the 
condition is due to controlling practices when we call it shame, guilt, 
or a sense of sin. 

Anger or rage. The emotional pattern which accompanies revolt 
includes responses of glands and smooth muscles and a well-marked 
effect upon operant behavior which includes a heightened disposition 
to act aggressively toward the controlling agent and a weakening of 
other behavior. The emotion may be displaced from the controlling 
agent to other people or to things in general. A mild example is a 
bad temper; an extreme one, sadism. I’he temper tantrum appears to 
be a sort of undirected revolt. 

Depression. Emotional responses associated with passive resistance 
are of several kinds. The stubborn child also sulks; the adult may be 
depressed, resentful, moody, listless, or bored, depending upon minor 
details of control. (Boredom arises not simply because there is noth¬ 
ing to do but because nothing can be done—either because a situa¬ 
tion is unfavorable for action or because the group or a controlling 
agency has imposed physical or self-restraint.) 

All these emotional patterns may, of course, be generated by aver¬ 
sive events which have nothing to do with social control. Thus a 
storm at sea may generate fear or anxiety, a door which will not open 
may engender frustration or rage, and something akin to sulking is 
the emotional counterpart of protracted extinction, as at the end of 
a long but fruitless struggle to win an argument or repair a bicycle. 
By far the greater part of the inciting circumstances of this sort. 
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however, are due to tlie control of the individual b\- the group or by 

sovernmental or religious agencies. 

I’he effects may be severe. Productive patterns of behavior are clis- 

torted by strong emotional predispositions, and the operant behavior 
which is strengthened in emotion may have disastrous consccpiences. 
Frequent or chronic emotional responses of glands and smooth 
muscles may injure the individual s health. Disorders of the digestive 
svstem including ulcers, and allergic reactions have been traced to 
chronic responses in fear, anxiety-, rage, or depression, Tlicsc are 
sometimes called "psychosomatic” disorders. Tlie term carries the 
unfortunate implication that the illness is the effect of the mind 
upon the body. As we have seen, it is sometimes correct to say that 
an emotional state causes a medical disability, as when a chronic 
response of glands or smooth muscles produces a structural change, 
such as an ulcer, but both cause and effect arc somatic, not psychic. 
Moreover, an earlier link in the causal chain remains to be identified. 
The emotional state which produces the disability must itself be 
accounted for and treated. The manipulablc variables of which both 
the somatic cause and the somatic effect are functions he m the 
environmental historv of the individual. Some psychosomatic symp¬ 
toms" are merelv pamllel effects of such a prior common cause. For 
example, an asthmatic attack is not the effect of anxiety, it is part 

of it. 


SOME EFFECTS OF CONTROL 
UPON OPERANT BEHA\'IOR 

Control through punishment may also have unforeseen effects 
upon operant behavior. The process of self-control miscarries when 
the individual discovers ways of avoiding aversive self-stimulation 
which prove eventuallv to be ineffective, troublesome, or dangerous. 
Emotional reactions may be involved, but we are concerned here 

with the operant effect only. 


Drug addiction as a form of escape. Certain drugs provide a tempo¬ 
rary- escape from conditioned or unconditioned aversive stimulation 
as well as from accompanying emotional responses. A'^ohol is con¬ 
spicuously successful. The individual who has engaged m behavior 
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wliich lias been punished, and who therefore feels guilty or ashamed, 
is reinforced when he drinks alcohol because self-generated aversive 
stimuli are thus suppressed. A ver>' strong tendency to drink may 
result from repeated reinforcement, especially if the aversive condi¬ 
tion is severe. The word "addiction” is often reserved for the case m 
which the drug provides escape from the aversive effects called with¬ 
drawal symptoms, which are produced by the earlier use of the drug 
itself. Alcohol may lead to this sort of addiction, but such drugs as 
morphine and cocaine show it more clearly. Addiction at this stage is 
a different problem, but the earlier use of the drug can usually be 
explained by its effect upon the consequences of punishment. 

Excessively vigorous behavior. The indis idual may show an unu¬ 
sually high probability of response which is not "well adapted to 
reality” in the sense that the behavior cannot be accounted for in 
terms of current variables. It can sometimes be explained by pointing 
to an earlier history of control. When effective escape is impossible, 
for example, a highly aversive condition may evoke ineffective behav¬ 
ior in the form of aimless wandering or searching. Simple "ner\ous- 
ncss” is often of this sort. The individual is uneasy and cannot rest, 
although his behavior cannot be explained plausibly in terms of its 

current consequences. 

Sometimes there arc obvious consequences, but we need to appeal 
to an earlier history to show why they arc reinforcing. For example, 
behavior may provide a measure of escape by generating stimuli 
which evoke reactions incompatible with the emotional by-products 
of punishment. Thus in "thrill-seeking” the individual exposes him¬ 
self to stimuli which evoke responses incompatible with depression 
or boredom. \Vc explain why the “thrill” is reinforcing by showing 
that it supplants an aversive result of excessive control. Sometimes 
the behavior to be explained can be shown to be a form of “doing 
something else.” A preoccupation which does not appear to offer 
commensurate positive reinforcement is explained by showing that 
it avoids the aversive consequences of some other course of action. 
Some compulsions and obsessions appear to have this effect. A pre¬ 
occupation with situations in which punished behavior is especially 
unlikely to occur may be explained in much the same way. When the 
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excessive behavior is an extension of a technique of self-control in 
which the environment is altered so that it becomes less likeU’ to gen¬ 
erate punished behavior, the effect is Freud’s “reaction formation. 


Excessively restrained behavior. Tlic special caution with which 
one drives a car after an accident or near accident may also be gen¬ 
erated by the a\'ersi\'c events used in control. Repeated pumslnncnt 
may produce an inhibited, shy. or taciturn person. In the so-called 
“hysterical paralyses" the restraint may be complete. Tlic etiology is 
usually clear when the paralysis is limited to a particular part of the 
topography of behavior. 'I'hus the individual who is excessively pun¬ 
ished for talking may stop talking altogether in “hysterical aphasia." 
No control, aversive or othenvise, will succeed in generating verbal 
behavior. Similarlv, the individual who has been punished—perhaps 


only through self-generated aversive consequences—for striking a 
friend may develop a paralyzed arm. This is different from the paraly¬ 
sis of fear. It is the difference between being too frightened to move 
and being afraid to move. The first of these conditions can be gen¬ 
erated by an event which is not contingent upon behavior, and it is 
usually not localized topographically. The second is a result of the 
punishing consequences of previous movement. 


Defective stimulus control. When behavior has been severely pun¬ 
ished, either by a controlling agency or by the physical environment, 
the individual may come to make ineffective or inaccurate discrimi¬ 
native responses. A stimulus similar to that which evoked the pun¬ 
ished behavior may evoke no response whatsoever. When the stimu¬ 
lus pattern is complex, we say that the individual “refuses to face the 
facts.” When, for example, he does not see a ver>' obvious object, we 
say that he suffers from a “negative hallucination.” All reactions to a 
given mode of stimulation are absent in hysterical anesthesia. A child 
mav begin by “paying no attention” to a nagging parent, but the 
behavior of “doing something else instead” may be so successful in 
avoiding a^■ersi^'e stimulation and possibly aversive emotional re¬ 
sponses to such stimulation that a complete “functional” deafness 

may develop. 

A commoner result is simply defective discrimination. In pro)ec- 
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tion, for example, tlie individual reacts incorrectly or atypically to a 
given state of affairs, and his behavior can often be traced to the 
avoidance of effects of control. In a “show of bravado” a situation is 
characterized as nothing to be afraid of and is therefore less likely to 
generate the fear for which the individual has been punished. In 
some hallucinations a situation in which punishment has been re¬ 
ceived is “seen” as free of any threat. In a delusion of persecution a 
distorted reaction to the environment permits the individual to 
escape from the aversive self-stimulation generated by behavior or a 
failure to behave for which he has been punished. 


Defective self-knowledge. Tlie individual may also react defec¬ 
tively to stimuli generated by his own behavior. In simple boasting, 
for example, he characterizes his own behavior in a way which 
escapes aversive stimulation. He boasts of achievement to escape the 
effects of punishment for incompetence, of bravery to escape the 
effects of punishment for cowardice, and so on. This sort of ration¬ 
alizing is best exemplified by delusions of grandeur in which all aver¬ 
sive self-stimulation may be effectively masked. It has already been 
shown that complete lack of self-knowledge—a form of negative hal¬ 
lucination or hysterical anesthesia restricted to self-stimulation—can 
be attributed to the avoidance of the effects of punishment (Chap¬ 
ter XVIII). 

Aversive self-stimulation. One may injure oneself or arrange to be 
injured by others. One may also deprive oneself of positive rein¬ 
forcers or arrange to be so deprived by others. These consequences 
may or may not be contingent upon behavior in the form of punish¬ 
ment, and we have seen that the effect of the contingency is, in any 
case, not clear. Such self-stimulation is explained if it can be shown 
that the individual thus avoids even more aversive consequences. If a 
conditioned aversive stimulus characteristically precedes the uncon¬ 
ditioned by an appreciable inteix'al of time, the total effect of the 
prolonged conditioned stimulus may be more aversive than that of 
the briefer unconditioned stimulus. The individual can then escape 
from the anxiety of impending punishment by “getting it over with.” 
The murderer in Dostoevski’s Crime and Punishment turns himself 
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over to a punishing governmental agent. Religious confession occurs 
because expiation is less aversive than a sustained sense of sin. It has 
been argued, particularly by Freud, that "accidents are sometimes a 
species of aversive self-stimulation which alleviates a condition of 

guilt or sin. 

It is not always possible to find a specific history' of punishment 
which will explain a given instance of aversive self-stimulation. Why 
an individual injures himself or arranges to be injured by others 
"masochistically” may be difficult to explain. In the absence of a 
more obvious explanation, it may be argued that such behavior 
reduces a sustained state of shame, guilt, or sin. When many differ¬ 
ent kinds of responses have been punished under many different 
circumstances, conditioned aversive stimuli may be widely distrib¬ 
uted in the environment, and a condition of anxiety may be chronic. 
Under these circumstances aversive self-stimulation may be positively 
reinforcing. Another possible explanation of masochistic self-stimu¬ 
lation is that the process of respondent conditioning has been effec¬ 
tive in the wrong direction. In punishment aversive stimuli are paired 
with the strongly reinforcing consequences of, say, sexual behavior. 
The expected result is that sexual behavior will automatically gener¬ 
ate conditioned aversive stimuli-but the aversive stimuli used in 
punishment may become positively reinforcing in the same process. 


PSYCHOTHERAPY AS A 
CONTROLLING AGENCY 

Behavior which is inconvenient or dangerous to the individual 
himself or to others often requires "treatment.” Formerly this treat¬ 
ment was left to friends, parents, or acquaintances, or to representa¬ 
tives of controlling agencies. In simple "good advice” a course of 
action which should have advantageous consequences is recom¬ 
mended. A great deal of casual therapy is prescribed m proverbs, 

folklore, and other forms of lay wisdom. 

Psychotherapy represents a special agency which concerns itself 

with this problem. It is not an organized agency, like a government 

or religion, but a profession, the members of which obse^^'e more or 
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less standardized practices. Ps}’chotherapy has already become an 
important source of control in the lives of many people, and some 
account is therefore required here. 

Diagnosis. The psychotherapist must of course know something 
about the patient whom he is treating. He must have certain infor¬ 
mation about his history-, about the behavior which calls for treat¬ 
ment, and about the current circumstances in which the patient lives. 
The examination of the patient has been heavily emphasized in 
clinical psycholog)'. How to conduct an interview, how to take a life 
historv, how to analyze trains of thought in free association, how to 
determine probabilities of response from projective tests or dreams, 
and how to use these probabilities to infer histories of deprivation, 
reinforcement, or emotional stimulation have all been studied. Tests 
of intelligence and other traits have been devised to enable the 
therapist to predict how readily the patient will react to various kinds 
of therapy. 

It is often implied that diagnosis, merely as the collection of infor¬ 
mation about the patient, is the only point at which a science of 
behavior can be helpful in therapy. Once all the facts about an indi¬ 
vidual have been collected, treatment is left to good judgment and 
common sense. This is an example of a broad misunderstanding of 
the application of the methods of science to human behavior. The 
collecting of facts is only the first step in a scientific analysis. The 
demonstrating of functional relationships is the second. When the 
independent variables are under control, such relationships lead 
directly to control of the dependent variable. In the present case, 
control means therapy. An adequate science of human behavior 
should make perhaps a greater contribution to therapy than to diag¬ 
nosis. Nevertheless, the extension of science to therapy has met with 
resistance, possibly for certain reasons to be considered in Chapter 
XXIX. 

Tlie steps which must be taken to correct a given condition of 
behavior follow directly from an analysis of that condition. Whether 
they can be taken will depend, of course, upon whether the therapist 
has control over the relevant variables. 
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Therapy. The initial power of the therapist as a controlling agent 
arises from the fact that the condition of the patient is aversive and 
that any relief or promise of relief is therefore positively reinforcing. 
To explain why the patient turns to the therapist in any given in¬ 
stance requires the analysis of a rather complicated histors', much of 
which is verbal. Assurances of help, various forms of evidence winch 
make such assurances effective, the prestige of the therapist, reports 
of improvement in other patients, slight signs of early improvement 
in the patient himself, evidences of the wisdom of the therapist in 
other matters—all enter into the process but in much too complex a 
way to be analyzed here. In addition the therapist may use variables 
which are available to him in personal control or as a member of the 
ethical group or which derive from his resemblance to members of 
the patient’s family or to governmental or religious agents who have 

already established control in other ways. 

All in all, however, the original power of the therapist is not very 

great. Since the effect which he is to achieve requires time, his first 
task is to make sure that the time will be available. The therapist 
uses whatever limited power he originally possesses to make sure that 
the patient will remain in contact with him—that the patient will 
return for further treatment. As treatment progresses, however, his 
power increases. As an organized social system develops, the therapist 
becomes an important source of reinforcement. If he is successful in 
providing relief, the behavior of the patient in turning to him for 
help is reinforced. The therapist's approval may become especially 
effective. As his knowledge of the patient grows, he may also use 
positive reinforcers which are, in a sense, beyond his control by 
pointing up contingencies between particular forms of behavior and 
particular consequences. He may demonstrate, for example that 
various aversive events actually result from the patient s own behav¬ 
ior He may suggest modes of action which are likely to be positive^ 
reinforced. Once the therapist has acquired the necessary control, he 
may also suggest schedules or routines which affect levels of depriva¬ 
tion or satiation, which arrange for the presentation of stimuli lead¬ 
ing to the conditioning or extinction of emotional reflexes, which 
eliminate stimulating situations having unfortunate consequences. 
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and so on. These schedules, adopted first because of the verbal con¬ 
trol of the therapist, eventually acquire other sources of strength if 
their effect upon the condition of the patient is reinforcing. 

The nonpunisbing audience. The commonest current technique of 
psychotherapy is due to Sigmund Freud. It has been characterized in 
many different ways in many different theories of behavior. So far 
as we are concerned here, it may be described simply in this way: 
the therapist constitutes himself a nonpunishing audience. The proc¬ 
ess through which he does this may take time. From the point of 
view of the patient, the therapist is at first only one more member of 
a society which has exerted excessive control. It is the task of the 
therapist to establish himself in a different position. He therefore 
consistently avoids the use of punishment. He does not criticize his 
patient nor object to his behavior in any way. He does not point out 
errors in pronunciation, grammar, or logic. In particular, he avoids 
any sign of counteraggression when the patient criticizes or other¬ 
wise injures him. The role of nonpunisher is made clearer if the 
therapist frequently responds in ways which are incompatible with 
punishment—for example, if he returns a conspicuous demonstration 
of friendship for aggressive attack or dismisses the patient’s report of 
punishable behavior with a casual, “That’s interesting.” 

As the therapist gradually establishes himself as a nonpunishing 
audience, behavior which has hitherto been repressed begins to 
appear in the repertoire of the patient. For example, the patient may 
recall a previously forgotten episode in which he was punished. Early 
experiences in which aversive control was first felt, and which have 
been long repressed, often supply dramatic examples. The patient 
may also begin to describe current tendencies to behave in punish¬ 
able ways—for example, aggressively. He may also begin to behave 
in punishable ways: he may speak ungrammatically, illogically, or in 
obscene or blasphemous terms, or he may criticize or insult the thera¬ 
pist. Nonverbal behavior which has previously been punished may 
also begin to appear: he may become socially aggressive or may 
indulge himself selfishly. If such behavior has been wholly repressed, 
it may at first reach only the covert level; the individual may begin 
to behave verbally or nonverbally “to himself”—as in fantasying pun- 
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ished behavior. The behavior may later be brought to the overt level. 
The patient may also begin to exhibit strong emotions: he may have 
a good cr^', make a violent display of temper, or be hysterieally 

silly. 

If, in the face of such behavior, the therapist is successful in main¬ 
taining his position as a nonpunisher, the process of reducing the 
effect of punishment is accelerated. More and more punished behav¬ 
ior makes its appearance. If, however, the therapist becomes critical 
or otherwise punishes or threatens to punish, or if previously pun¬ 
ished behavior begins to be emitted too rapidly, the process may 
suddenly cease. The aversive condition which arises to reverse the 
trend is sometimes spoken of as “resistance. 

There is a second stage in the therapeutic process. The appear¬ 
ance of previously punished behavior in the presence of a nonpun¬ 
ishing audience makes possible the extinction of some of the effects 
of punishment. This is the principal result of such therapy. Stimuli 
which are automatically generated by the patient’s own behavior 
become less and less aversive and less and less likely to generate 
emotional reactions. The patient feels less wrong, less guilty, or less 
sinful. As a direct consequence he is less likely to exhibit the various 
‘ forms of operant behavior which, as we have seen, provide escape 
from such self-generated stimulation. 


PSYCHOTHERAPY VERSUS RELIGIOUS AND 
GOVERNMENTAL CONTROL 

The principal technique of psychotherapy is thus designed to 
reverse behavioral changes which have come about as the result of 
punishment. Very frequently this punishment has been administered 
by religious or governmental agencies. There is, therefore, a certain 
opposition between psychotherapy and religious and governmental 
control. The opposition is also seen when the psychotherapist advo¬ 
cates changes in established controlling techniques. For example, he 
may recommend a modification of police action against young 
offenders or certain types of psychopathic personalities. This oppo¬ 
sition has attracted considerable attention. Representatives of some 
religious agencies have accused psychotherapists of fostering immoral 
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tendencies, and, for similar reasons, government officials have resisted 
reforms proposed by psychotherapists. 

Although there is a fundamental opposition in the behavioral 
processes employed, there is not necessarily any difference in the 
behavior which these three agencies attempt to establish. The psy¬ 
chotherapist is interested in correcting certain by-products of control. 
Even though he may dispute the efficacy of certain techniques, he 
will probably not question the need for the behavior which the 
religious or governmental practice is designed to establish. In avoid¬ 
ing the by products of excessive control, he may reinstate a certain 
amount of selfish behavior in the individual by weakening the aver¬ 
sive stimulation which results from religious or governmental con¬ 
trol; but he will agree that selfish behavior must be suppressed by the 
group and by agencies operating within and for the group, and he 
must prepare his patient to accept this control. 

The techniques available to religious and governmental agencies 
arc extremely powerful, and they are frequently misused with dis¬ 
advantageous results both to the individual and to the group. Some 
degree of countercontrol on the part of psychotherapy or some simi¬ 
lar agency is therefore often needed. Since the variables under the 
control of the therapist are relatively weak, and since he must oper¬ 
ate within certain ethical, religious, and legal limits, he can scarcely 
be regarded as a serious threat. Whether we can decide ultimately 
upon the “best” degree of religious or governmental control will be 
considered in Section VI. 

TRADITIONAL INTERPRETATIONS 

What is “wrong” with the individual who displays these by-prod¬ 
ucts of punishment is easily stated. A particular personal history has 
produced an organism whose behavior is disadvantageous or danger¬ 
ous. In what sense it is disadvantageous or dangerous must be speci¬ 
fied in each case by noting the consequences both to the individual 
himself and to others. The task of the therapist is to supplement a 

personal history in such a way that behavior no longer has these 
characteristics. 

This is not, however, the traditional view. The field of psycho- 
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therapy is rich in explanator\’ fictions. Behavior itself has not been 
accepted as a subject matter in its own right, but only as an indica¬ 
tion of something wrong son^ewhere else. 'I'hc task of therapy is said 
to be to remedv an inner illness of which the behavioral inanifesta- 
tions are nierelv “svmptoms.” Just as religious agencies maximize 
salvation or pietv, and governmental agencies justice, freedom, or 
security, so psychotherapy is dedicated to the maximizing of mental 
health or personal adjustment. I’hesc terms are usually negative be¬ 
cause they are defined by specifying unhealthy or maladjusted be¬ 
havior which is absent in health or adjustment. Frequently, the 
condition to be corrected is called “neurotic,” and the thing to be 
attacked bv psvehotherapy is then identified as a “neurosis.” I'hc 
term no longer carries its original implication of a derangement of 
the nerv'Oiis system, but it is nevertheless an unfortunate example of 
an explanator)' fiction. It has encouraged the therapist to avoid speci¬ 
fying the behavior to be corrected or showing why it is disadvan¬ 
tageous or dangerous. By suggesting a single cause for multiple 
disorders it has implied a uniformity which is not to be found in the 
data. Above all. it has encouraged the belief that psychotherapy con¬ 
sists of removing certain inner causes of mental illness, as the surgeon 
removes an inflamed appendix or cancerous growth or as indigestible 
food is purged from the body. We have seen enough of inner causes 
to understand why this doctrine has given psychotherapy an impos¬ 
sible assignment. It is not an inner cause of behavior but the behavior 
itself which—in the medical analogy of catharsis—must be “got out of 
the system.” 

The belief that certain kinds of “pent-up” behavior cause trouble 
until the organism is able to get rid of them is at least as old as the 
Greeks. Aristotle, for example, argued that tragedy had a beneficial 
effect in purging the individual of emotional behavior. On the same 
analogy it has been argued that competitive sports permit both the 
participant and the spectator to rid themselves of aggressive ten¬ 
dencies. It has been argued that the human infant has a certain 
amount of sucking behavior which he must eventually get rid of, 
and that if he does not exhaust this behavior in the normal process 
of nursing, he will suck his fingers or other objects. We have seen 
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that it is meaningful to say that an organism is disposed to emit 
behavior of a given form in a given amount. Such behavior spends 
itself in the process of extinction, for example. But it does not follow 
that a potential disposition causes trouble or has any other effect 
upon the organism until it has been spent. There is some evidence 
that sucking behavior in the infant is reinforced by nursing and is 
then made more rather than less likely to occur. It is also a tenable 
hypothesis that competitive sports generate rather than relieve aggres¬ 
sive tendencies. In any case, the variables to be considered in dealing 
with a probability of response are simply the response itself and the 
independent variables of which it is a function. We have no reason 
to appeal to pent-up behavior as a causal agent. 

On the assumption that the inner causes of neurotic or maladjusted 
behavior are subject to gross physiological assault, cures are some¬ 
times attempted by administering drugs, by performing surgery upon 
the nervous system, or by using drugs or electric shock to set off vio¬ 
lent convulsions. Such therapy is obviously directed toward a sup¬ 
posed underlying condition rather than toward the behavior itself or 
the manipulable variables outside the organism to which the behavior 
may be traced. Even “functional” therapy, in which external vari¬ 
ables are manipulated, is often described with the same figure of 
speech. The therapist is regarded as rooting out a source of trouble. 
The conception is not far removed from the view—which large num¬ 
bers of people still hold—that neurotic behavior arises because the 
Devil or some other intruding personality is in temporary “posses¬ 
sion” of the body. The traditional treatment consists of exorcising 
the Devil—driving him out of the individual by creating circum¬ 
stances which are appropriately aversive to him—and some treatments 
of multiple personality differ from this only in avoiding theological 
implications. The lesser demons of modem theory are anxieties, con¬ 
flicts, repressed wishes, and repressed memories. Just as pent-up 
emotion is purged, so conflict is resolved and repressed wishes and 
memories are released. 

This view of mental illness and therapy owes most to Sigmund 
Freud. It appears to have withstood assault largely because of Freud’s 
contributions in other directions. His great achievement, as a dis- 
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ciple of his said recently, was to apply the principle of cause and effect 
to human behavior. Aspects of behavior which had hitherto been 
regarded as whimsical, aimless, or accidental, Freud traced to rele\ant 
variables. Unfortunately, he chose to represent the relationships he 
discovered with an elaborate set of cxplanatorv' fictions. He charac¬ 
terized the ego, superego, and id as inhabitants of a psycliic or mental 
world subdivided into regions of conscious, co-conscious, and un¬ 
conscious mind. He divided among these personalities a certain 
amount of psychic energ}-, which flowed from one to the other in a 
sort of hydraulic system. Curiously enough, it was Freud himself who 
prepared the way for dismissing these cxplanator\' fictions. By insist¬ 
ing that many mental events could not be directly observed, even by 
the individual himself, he widened the scope of the psychic fiction. 
Freud took full advantage of the possibilities, but at the same time 
he encouraged an analysis of the processes of inference through 
which such events might be known. He did not go so far as to con¬ 
clude that references to such events could be avoided altogether; 
but this was the natural consequence of a further examination of the 

evidence. 

Freud’s conceptions of mental disease and therapy were closely 
related to his conception of a mental life. Psychoanalysis was re¬ 
garded as depth psychology', concerned with discovering inner and 
otherwise unobserv'able conflicts, repressions, and springs of action. 
The behavior of the organism was often regarded as a relatively un¬ 
important by-product of a furious struggle taking place beneath the 
surface of the mind. A wish which has been repressed as the result 
of aversive consequences struggles to escape. In doing so it resorts 
to certain devices which Freud called “dynamisms”-tricks which the 
repressed wish uses to evade the effects of punishment. Therapy is 
concerned with discovering the repressed wish and rooting it out, or 
occasionally repressing it more securely, so that the symptoms will 

disappear. _ ^ • i. 

The present view of therapy is quite different. Tlie Freudian wish 

is a device for representing a response with a given probability of 
occurrence. Any effect of ‘‘repression” must be the effect of the vari¬ 
ables which have led either to the response itself or to the repressing 
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behavior. We have to ask why the response was emitted in the first 
place, why it was punished, and what current variables are active. 

'I hc answers should account for the neurotic behavior. Where, in the 
Freudian scheme, behavior is merely the symptom of a neurosis, in 
the present formulation it is the direct object of inquiry. 

Let us consider the apparent result of the struggle of a wish to 
express itself. An example which permits us to observe the principal 
I’rcudian dynamisms is sibling rivalr)\ Let us say that two brothers 
compete for the affection of their parents and for other reinforcers 
which must be divided between them. As a result, one brother be- 
ha\cs aggressively toward the other and is punished, by his brother 
or by his parents. Let us suppose that this happens repeatedly. Even¬ 
tually any situation in which aggressive action toward the brother is 
likely to take place or any early stage of such action will generate the 
conditioned aversive stimulation associated with anxiety or guilt. This 
is effective from the point of view of the other brother or the punish¬ 
ing parent because it leads to the self-control of aggressive behavior; 
the punished brother is now more likely to engage in activities which 
compete with and displace his aggression. In this sense he “represses” 
his aggression. The repression is successful if the behavior is so effec¬ 
tively displaced that it seldom reaches the incipient state at which it 
generates anxiety. It is unsuccessful if anxiety is frequently generated. 
Other possible consequences, which are described by the so-called 
dynamisms, arc as follows: 

T he same punishment may lead the individual to repress any 
knowledge of his aggressive tendencies (Chapters XVII and XVIII). 
Not only does he not act aggressively toward his brother, he does not 
even “know” that he has tendencies to do so. 

Me may control himself by changing the external environment so 
that it is less likely to evoke aggressive behavior, not only in himself 
but in others. As an example of reaction formation, he may engage 
in social work, in campaigns against racial discrimination, or in sup¬ 
port of a philosophy of brotherly love. We explain his behavior by 
showing that it contributes to the suppression of his own aggressive 
impulses and hence toward a reduction in the conditioned aversive 
stimulation resulting from punishment (Chapter XV). 
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He may actually injure his brother but rationalize his conduct. For 
example, he may discipline his brother “for his own good or may be 
especially energetic in cann ing bad news to him “because he ought 
to know the worst.” I’hcsc expressions describe the behavior in such 
a way that punisliment is withheld by others and conditioned aver- 
si\'c stimulation fails to be generated in the indis'idual s own be¬ 
havior (Chapter XVIII). 

He may sublimate his aggression by taking up an occupation in 
which such behavior is condoned. For example, he may join the 
armed scrs'ices or the police or get employment in an abattoir or 
wrecking company, ^’his is response induction if different forms of 
the behavior of striking arc strengthened by a variable which strength¬ 
ens striking his brother (Chapter VI); it is stimulus induction if dif¬ 
ferent stimuli which show any property in common with his brotlier 

evoke striking. 

He may fantasy injuring or killing his brother. If this also generates 
aversis’C stimulation, he may fantasy injuring or killing other people. 
If he has the talent, he may write stories about the murder of a 
brother, or if there is anxiety in connection with the word "brother,” 

about other murders (Chapter XVIII). 

He may dream of injuring or killing his brother or, if this generates 

aversive stimulation, of injuring or killing someone who symbolizes 
his brother—perhaps an animal which in another part of the dream 

takes on his brother’s features (Chapter XVIII). 

He may displace his aggression by "irrationally” injuring an inno¬ 
cent person or thing (Chapter X). This may occur simply because 
emotional responses show stimulus induction a man who is angry 
with an absent office boy takes it out on another employee-or be¬ 
cause the displaced behavior will not be punished, at least so severely 
_a man who is angry with his boss takes it out on the office boy- 

He may engage in aggressive wit by saying something which in one 
sense injures his brother but in another escapes censure. The remark 
is injurious and punishable if it is attributed to one variable, but not 
if it is attributed to another. The response is witty simply in the 
sense of being a function of two variables (Chapter XIV). 

He may identify himself with prize fighters or with characters in a 



378 CONTROLLING AGENCIES 

sadistic movie or in stories about men who injure or kill their 
brothers, in the sense that he will be highly disposed to imitate their 
verbal and nonverbal behavior (Chapter XIV). He will be reinforced 
by such stories and will report this fact, together with the ernotional 
reaction common to positive reinforcers, by saying he "enjoys” them. 

He may project his aggression by describing a picture in which two 
men are fighting as a picture of brothers (Chapter XIV), in the sense 
that he is disposed to imitate such behavior and to suppose that the 
men in the picture are responding to the same variables. 

He may respond aggressively in a Freudian slip —for example, by 
saying, “I never said I didn’t hate my brother” instead of "I never 

said I hated my brother” (Chapter XIV). 

He may forget to keep an appointment with his brother or with 

anyone who resembles him (Chapter XIV). 

He may escape anxiety about punishment by '^punishing himself’ 
—by masochistic behavior, by forcing himself to undertake arduous 
or dangerous work, or by encouraging accidents. 

He may develop certain physical symptoms, especially when he 
is with his brother. These may be a characteristic form of competi¬ 
tive behavior from which he gains an advantage, or the presence of 
his brother may arouse strong responses of glands and smooth mus¬ 
cles which have an injurious effect. 

It would be difficult to prove that all these manifestations are due 
to the early punishment of aggressive behavior toward a brother. But 
they are reasonable consequences of such punishment, and the early 
history may be appealed to if no other variables can be discovered to 
account for the behavior. (If the behavior has no connection with 
such a history, there is so much the less to explain in a scientific 
analysis.) 

Such manifestations are simply the responses of a person who has 
had a particular history. They are neither symptoms nor the surrep¬ 
titious expression of repressed wishes or impulses. The dynamisms 
are not the clever machinations of an aggressive impulse struggling 
to escape from the restraining censorship of the individual or of 
society, but the resolution of complex sets of variables. Therapy does 
not consist of releasing a trouble-making impulse but of introducing 
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variables which compensate for or correct a liistor> which has pro¬ 
duced objectionable behavior. Pent-up emotion is not the cause of 
disordered behavior; it is part of it. Not being able to recall an early 
incmors' docs not produce neurotic symptoms; it is itself an example 
of ineffective bcha\ ior. It is quite possible that in therapy the pent-up 
emotion and the behavioral symptom may disappear at the same 
time or that a repressed meinors' will be recalled when maladjusted 
behavior has been corrected. Put this does not mean that one of these 
events is the cause of the other. They may both have been products 
of an environmental histors" which therapy has altered. 

In emphasizing ‘ neurotic” behavior itself rather than any inner 
condition said to explain it. it may be argued that we arc committing 
the unforgivable sin of "treating the symptom rather than the cause.” 
This expression is often applied to attempts to remove objectionable 
features of behavior without attention to causal factors—for example, 
"curing” stammering by a course of vocal exercises, faulty posture 
bv the application of shoulder braces, or thumb-sucking by coating 
the thumb with a bitter substance. Such therapy appears to disregard 
the underlying disorder of which these characteristics of behavior 
arc symptoms. But in arguing that behavior is the subject matter of 
therapy rather than the svmptom of a subject matter, we are not 
making the same mistake. By accounting for a given example of dis¬ 
advantageous behavior in terms of a personal histor>' and by altering 
or supplementing that histor>' as a form of therapy, we are consider¬ 
ing the very variables to which the traditional theorist must ulti¬ 
mately turn for an explanation of his supposed inner causes. 

OTHER THERAPEUTIC TECHNIQUES 

There are many other ways in which behavior which calls for 
remedial action may be corrected. When the difSculty cannot be 
traced to the excessive use of punishment or to other aversive cir¬ 
cumstances in the history of the individual, different therapeutic 
techniques must be developed. There is the converse case for ex¬ 
ample, in which ethical, governmental, or religious control has been 
inadequate. The individual may not have been m contact with con¬ 
trolling agents, he may have moved to a different culture where his 
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early training is inadequate, or he may not be readily accessible to 
control. Therapy will then consist of supplying additional controlling 
variables. When the individual is wholly out of control, it is difficult 
to find effective therapeutic techniques. Such an individual is called 

psychotic. . , . . 

Sometimes the therapist must construct a new repertoire which 

will be effective in the world in which the patient finds himself. 
Suitable behavior already in the repertoire of the patient may need 
to be strengthened, or additional responses may need to be added. 
Since the therapist cannot foresee all the circumstances in which the 
patient will find himself, he must also set up a repertoire of self- 
control through which the patient will be able to adjust to circum¬ 
stances as they arise. Such a repertoire consists mainly of better ways 
of escaping from the aversive self-stimulation conditioned by punish- 

meat. . 

Such constructive techniques may be needed after the nonpunish¬ 
ing audience of the therapist has had its effect. If the condition which 
is being corrected is the by-product of controlling circumstances 
which no longer exist in the life of the patient, alleviation of the 
effects of excessive control may be enough. But if the patient is likely 
to be subjected to continued excessive or unskillful control, therapy 
must be more constructive. The patient may be taught to avoid occa¬ 
sions upon which he is likely to behave in such a way as to be pun¬ 
ished, but this may not be sufficient. An effective repertoire, 
particularly in techniques of self-control, must be constructed. 

As another possible source of trouble, the individual may have 
been, or may be, strongly reinforced for behavior which is disadvan¬ 
tageous or dangerous. Behavior which violates ethical, governmental, 
or religious codes is often by its very nature strongly reinforcing. 
Sometimes, accidental contingencies may also arise. In Sacha Guitry’s 
film. The Story of a Cheat, a child is punished for some trivial mis¬ 
behavior by being denied his supper. But the supper turns out to 
be poisonous, and the child is the only one of a large family to sur¬ 
vive. The implication that the child will then dedicate himself to a 
life of crime is not entirely fanciful. Positive reinforcement in atypical 
situations produces other forms of ineffective or even crippling be- 
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havior. For example, the social reinforcement supplied by a particular 
person may become vcr\’ powerful, and it may be contingent upon 
behavior which is not effective in the world at large. 'I’hus when a 
solicitous parent supplies an unusual measure of affection and attcu' 
tion to a sick child, anv behavior on the part of the child which cm- 
phasi7XS his illness is strongly reinforced. It is not surprising that the 
child continues to behave in a similar fashion when he is no longer 
ill. This may begin as simple malingering, when it is scarcely to be 
distinguished from the behavior of the malingerer who claims to 
have been injured in an accident in order to collect damages, but it 
may pass into the more acute condition of hysterical illness if the 
chiid himself becomes unable to identify the relevant variables or 
correctly appraise the possibilities of his own behas'ior. Other sorts 
of social consequences have similar effects. The child who is angry 
with his parents is reinforced when he acts in any way which injures 
them—for example, in any way which annoys them. If such a condi¬ 
tion is long sustained, a repertoire may be established which will 
work to the disadvantage of the child in his dealings with other 
people. One obvious remedial technique for behavior which is the 
product of excessive reinforcement is to arrange new contingencies 
in which the behavior will be extinguished. The child is no longer 
reinforced with affection for feigning illness or with a strong emo¬ 
tional response for being annoying. 

Just as the traditional conception of responsibility is abandoned as 
soon as governments turn to techniques of control other than the use 
of punishment, so the conception of therapy as the rooting out of 
inner causes of trouble is not likely to be invoked to explain these 
constructive techniques. There is, however, a roughly parallel ex¬ 
planation which has been applied to all techniques of therapy. When 
a therapist encounters a patient for the first time, he is presented 
with a "problem” in the sense of Chapter XVI. The patient usually 
shows a novel pattern of disadvantageous or dangerous behavior, 
together with a novel history in terms of which that behavior is to 
be understood. The particular course of therapy needed in altering 
or supplementing this history may not be immediately obvious. How¬ 
ever, the therapist may eventually "see what is wrong” and be able 
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to suggest a remedial course of action; this is his solution to the 
problem. Now therapeutic experience has shown that when such a 
solution is proposed to an individual, it may not be effective even 
though, so far as we know, it is correct. But if the patient arrives at 
the solution himself, he is far more likely to adopt an effective 
course of action, ^^le technicjue of the therapist takes this fact into 
account. Just as the psychoanalyst may wait for a repressed memory 
to make itself manifest, so the nonanalytic therapist waits for the 
emergence of a solution from the patient. But here again we may 
easily misunderstand the causal relation. “Finding a solution is not 
therapy, no matter who does the finding. Telling the patient what is 
wrong may make no substantial change in the relevant independent 
variables and hence may make little progress toward a cure. When the 
patient himself sees what is wrong, it is not the fact that the solu¬ 
tion has come from within him which is important but that, in order 
to discover his own solution, his behavior with respect to his prob¬ 
lem must have greatly altered. It follows from the nature of disad¬ 
vantageous or dangerous behavior that a substantial change must be 
accomplished if the individual is to identify the relevant variables. 
A solution on the part of the patient thus represents a substantial 
degree of progress. No such progress is implied when the therapist 
states the solution. Therapy consists, not in getting the patient to 
discover the solution to his problem, but in changing him in such a 
way that he is able to discover it. 

EXPLAINING THE 
PSYCHOTHERAPEUTIC AGENCY 

The therapist engages in therapy primarily for economic reasons. 
Therapy is a profession. The ser\'ices which the therapist renders 
are reinforcing enough to the patient and others to permit him to ex¬ 
change them for money (Chapter XXV). Usually the therapist is also 
reinforced by his success in alleviating the conditions of his patients. 
This is particularly apt to be true in a culture which reinforces help¬ 
ing others as a standard ethical practice. Frequently another impor¬ 
tant sort of reinforcement for the therapist is his success in manipu¬ 
lating human behavior. He may have a personal interest, for example, 
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in proving the value of a particular thcoiY’ of neurotic behavior or of 
therapeutic practice. These return effects upon the agency will 
determine in the long run the composition of the profession of psy¬ 
chotherapy and the uniformity of its practices. 

At certain stages in psychotherapy the therapist may gain a degree 
of control which is more powerful than that of many religious or 
governmental agents. There is always the possibility', as in any con¬ 
trolling agency, that the control will be misused. The coimtcrcontrol 
which discourages the misuse of power is represented by the ethical 
standards and practices of the organized profession of psychotherapy. 
The danger of misuse may, as we shall sec in Chapter XXIX, explain 
the current popularity of theories of psychotherapy which deny that 
human behavior can in the last analysis be controlled or which de¬ 
liberately refuse to accept responsibility for control. 




ECONOMIC CONTROL 


We turn now to the use of positive reinforcement in the 
practical control of behavior. This consists in general of the presen¬ 
tation of food, clothing, shelter, and other things which we call 
“goods.” 'I’he ctymolog)' is significant. Like the behavior of the 
individual which is positively reinforcing to the group, goods are 
“good” in the sense of being positively reinforcing. We sometimes 
speak of tlicm also as “wealth.” This term has a similar etymological 
connection with positive reinforcement, but it also includes general¬ 
ized conditioned reinforcers, such as money and credit, which are 
effective because they may be exchanged for goods. 

REINr-'ORCING BEIIAN'IOR WITH MONEY 

As a simple example of economic control an individual is induced 
to perform labor through reinforcement with money or goods. The 
controller makes the payment of a wage contingent upon the per¬ 
formance of work. In actual practice, however, the process is seldom 
as simple as this. When we tip a man or pay him for performing a 
small service and thereby increase the probability of his performing 
a similar service in the future, we do not depart far from the labora- 
lor)' study of operant reinforcement. Behavior has occurred and has 
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been strengthened bv its consequences. I’his is also roughly true 
when a man is steadily employed. His performance at a given time 
is mainly determined by the contingencies of reinforcement which 
have prevailed up to that time. W'hen an explicit agreement is made, 
however, prior verbal stimuli must be analyzed in order to account 
for the effect of the economic contingency. I'hus when we agree to 
pay a man a given amount for a gi\cn piece of work, our promise to 
pay is not far from the command analyzed in Chapter XXII, except 
that reinforcement is now positive rather than negative. Payment is 
contingent upon the verbal stimulus of the promise to pay and upon a 
correspondence between the topography of the behavior and certain 
verbal specifications. The offer, 'Til pay you two dollars if yon mow 
the lawn” specifies (1) behavior (“mowing the lawn”), (2) a rein¬ 
forcement (“two dollars”), and (3) a contingency (“if”). To the 
prospective employee the whole remark serves as an occasion which, 
if the offer is to be effective, must be similar to other occasions upon 
which similar contingencies have prevailed. 

\V.\GE SCHEDULES 

Fixed-ratio schedules. With the exception of payment “by the job,” 
the economic control of behavior follows certain schedules of rein¬ 
forcement. When a man is paid in terms of the number of units of 
work completed, the schedule is essentially that of a fixed ratio. It is 
usually known in industr)* as piecework pay. The same principle 
applies to commission selling, to the craftsman who makes and sells 
a standard product, to the writer who is paid by the story or book, 
and to the small private contractor. Fixed ratio is, in general, a very 
effective sehedule of reinforcement. If the ratio is not too high—that 
is, if the amount of work required per unit of pay is not too great— 
and if each reinforcement is of a significant amount, the individual 
will characteristically work at a high rate. This is as true of the pigeon 
in the laborator)^ as of the man in industr>'. An employee who has 
been paid on some other basis and then transferred to piecework pay 
will usually show a considerable increase in speed. The increase is 
partly the automatic result of the increasing frequency of reinforce- 
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nicnt which follows on a fixed-ratio schedule as the rate increases. 
Some of it is due, as we have seen, to the fact that a high rate of 
responding tends to prevail at the moment of reinforcement under 
such a schedule. Progress toward the completion of a given number 
of responses also has the effect of a conditioned reinforcer. The 
schedule is more effective if this progress is emphasized—for example, 
bv a visible counter. 

r 

A fixed-ratio schedule may, in fact, be too effective. It leads not 
onlv to high levels of activity, but to long working hours, both of 
which may be harmful. A bricklayer paid in terms of the number of 
bricks laid may “burn himself out” in a few years. Another objection 
to the use of the schedule in industry is that the increased return to 
the worker which follows conversion to such a schedule often seems 
to justify increasing the ratio. Let us suppose that an employee pro¬ 
ducing a hundred items per week is paid fifty dollars on a weekly 
basis and that the management offers to pay this instead on a piece¬ 
work basis of one dollar for even,’ two items. The effect upon the 
cniploNCC is a rapid increase in production. Let us suppose that he is 
able to increase his weekly wage to a hundred dollars. In terms of 
current rates of pay this may appear to justify increasing the number 
of items required per dollar to, say, three. As the piecework schedule 
remains in force, production may continue to rise. In the long run a 
veiy much higher rate of work may be generated by only a slight 
increase in weekly pay. This is precisely the way in which in the 
laborator)' a high rate of responding is generated under a fixed-ratio 
schedule. 

When the ratio is high or the reinforcement trivial, a fixed-ratio 
schedule characteristically produces a period of inactivity just after 
each reinforcement. At very high ratios these periods may be greatly 
prolonged. They represent, as we have seen, a condition of abulia 
similar to that in complete extinction in which, although the depri¬ 
vation is severe, the individual simply “has no behavior available.” 
He finds it impossible to start on his next assignment. He may report 
this by saying that he is discouraged, that he can't face his job, and 
so on. A typical example of fixed-ratio pay is the salesman selling on 
commission. When “business is not good,” the amount of work 
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wliicli must be done per unit of reinforcement is high, and abulia is 
common. 

The ratio and the magnitude of the reinforcement show a subtle 
relation. Is a reinforcement of ten dollars per thousand items as effec¬ 
tive as one dollar per hundred, or one cent per item? It a man places 
a fixed economic value upon his labor, there should be no difference, 
but this is not the case. One can advance to a high ratio only after a 
long histors’ of reinforcement at lower ratios. Especially with unedu¬ 
cated labor the ratio may be crucial, rims a contractor who employed 
peasant labor to more earth with wheelbarrows found it most effec¬ 
tive to pay a small amount each time a full wheelbarrow was deliv¬ 
ered to the proper point, 'lire use of piecework pay in industry or 
elsewhere presupposes a considerable historj- of economic control. 

Fixed-interval schedules. Labor is most commonly paid by the day, 
week, month, or year. These appear to be fixed-interval schedules. 
The size of the interval, like the size of the ratio, is a rough function 
of earlier contingencies affecting the individual. The wages of the day 
laborer arc not only calculated on a daily basis, they are often paid 
daily also. Substantial reinforcement at shorter intervals is needed 
before payments spaced as much as a month apart are effective, o 
analyze such a histor)- in detail we should have to inycstigate certain 
subsidiary kinds of behavior, some of them verbal, which arc pner- 
ated by schedules of reinforcement and which bridge the gap bctvpcn 

working on, say. the first day of the month pd being 
the last. Such an analysis would have to include the effect of agree¬ 
ments or contracts between employer and employee. 

In any case, however, wages received at fixed intervals do not prallel 

the intermittent reinforcements described in Chapter VI. In huma 
behavior certain prominent stimuli, commonly correlated vv.th the 
time of payment, make a temporal discrimination possible. The per¬ 
formance of a pigeon or rat under fixed-interval reinforcement 
cLnges dramatical!; when a stimulus is arranged to vary.n some v^y 
with the passing of time between reinforcements. Clocks and ca ^ 
dars are verbal devices designed to supply stimuh of th sort to thp 
human subject. Wlien such stimuli are availab e, the 
whether human or subhuman-waits until the reading on the clock 
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is vcr\' close to that at which behavior is reinforced. If there were no 
other factors involved, payment for work at the end of each week 
would generate only a small amount of work just before pay-time. 

It is necessaiys therefore, to supplement fixed-interval schedules 
with other tcchnic|ucs of control. The supcr\'isor or boss is a source 
of aversive stimulation contingent upon any behavior which falls 
below certain specifications, including a minimum rate of produc¬ 
tion. Some of the power available to the supervisor may be deriv'ed 
from his position in the ethical group—he may condemn laziness or 
poor work as bad or something to be ashamed of—but insofar as he 
“can’t do anv worse than fire a man,” his main aversive stimulation 
is tlie threat of dismissal. Wages serve in such a case simply to create 
a standard economic condition which may be withdrawn aversively. 

1 he boss threatens dismissal, or some measure which is effective 
because it is a step toward dismissal, whenever the employee slows 
down; he removes that threat when the employee speeds up. Even- 
tualh the behavior of the employee generates comparable aversive 
stimulation; he works at a rate just above that at which he feels 
guiltv or threatened. I'lie use of an aversive boss is an excellent ex¬ 
ample of tlic general principle that when punishment is abandoned 
in favor of positive reinforcement, there is a tendency to turn to 
other forms of aversive control. The threat of withholding an accus¬ 
tomed positive reinforcement is always available for this purpose. 
Pavment of wages is an obvious advance over slaver^', but the use of a 
standard wage as something which may be discontinued unless the 
employee works in a given manner is not too great an advance. 

A production line moving at a set rate makes the contingency 
between speed of work and aversive stimulation more clear-cut. This 
“pacing” of behavior is by no means a modem achievement. The 
galley slave pulled his oar to avoid the whip, which was contingent 
upon his failing to pull in unison with others. A line of reapers swing¬ 
ing scythes in unison paced each other—the basic rhythm being deter¬ 
mined in part by a leader but also in part by the length and mass of 
the pendulum composed of man and scythe—because any deviation 
brought aversive stimulation, often dangerous, from the scythes of 
other reapers. The production line has the effect of reducing some of 
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the personal attributes of aversive stimulation by a boss, but a danger 
inherent in any pacing system is the temptation on the part of the 
controller to increase the pace. 

Combined schedules. Fixcd intcrsal schedules arc also supple¬ 
mented in industr\' by various sorts of “incentive pay.” ^I hcse arc com- 
binations of fixcd-intersal and fixed-ratio schedules. Each of the com¬ 
ponent schedules corrects some of the shortcomings of the other. 
Supplementary’ aversive stimulation from a supersisor is not needed 
if the ratio component is effective. At the same time the ratio com¬ 
ponent may not be enough to lead to dangerously high rates or long 
hours of work. When a salesman is paid partly on salary and partly 
on commission, the combination is designed to correct the abulia 
which might otherwise follow reinforcement at a high ratio. 

Variable schedules. Laboratory' studies have shown that variable- 
interv'al and variable-ratio schedules are superior to fixed schedules in 
sustaining performance, but it is not easy to adapt such schedules to 
the payment of wages. A contract between employer and employee 
which guarantees a given return, cither per inters-al of time or per 
unit of work, rules out a genuine variable schedule. Such schedules 
may be used, however, in the payment of money—such as a bonus— 
not specified in a contract or contingent upon behavior in any other 
way. The bonus would usually be classed as an emotional variable 
which predisposes the individual favorably toward his work or his 
employer, but it may also act as a reinforcer. Its effect as such is con¬ 
siderably reduced if it is given on a fixed-interval schedule. The stand¬ 
ard Christmas bonus, for example, eventually functions primarily as 
part of the pay which may be withdrawn as a form of aversive stimu¬ 
lation in dismissal. An unpredictable bonus, given in smaller sums on 
a variable-interval schedule but in approximately the same amount 
annually, would have a much greater effect. 

Differential reinforcement of quality of work. Wages are usually 
contingent upon specified behavior at a specified level of quality or 
skill. In general the performance of an employee, like that of the 
laboratory animal, adjusts quite accurately to the exact contingencies 
of reinforcement. Both “do no more than they need to do. Addi- 
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tional economic reinforcement may be made contingent upon work 
which exceeds minimum standards. Bonuses, raises, and promotions, 
when contingent upon exceptional performance, shape the topogra¬ 
phy of behavior in the direction of quality or skill (Chapter VI). 

Extra-economic factors. It is now generally recognized that the 
employee seldom works “just for the money. The employer who 
relics exclusively on economic control overlooks the fact that the 
average worker is reinforced in other ways. The individual craftsman 
not only constructs something which he can sell for money, he is 
reinforced by his success in dominating the medium in which he 
works and in producing an article for which he receives approval. 
These additional reinforcements may have a substantial effect in sus¬ 
taining his level of work. They are often lost in mass-production 
methods in which the worker receives only an economic reinforce¬ 
ment for his achievement. To say that the craftsman is motivated by 
“pride in his work" does not help us to understand the problem. In 
order to deal effectively with the behavior of the employee we must 
in any given case be able to specify the actual circumstances which 
are reinforcing, and perhaps how they have come to be reinforcing. 

'I he effect of the reinforcement of the worker is not shown in his 
rate of production if that rate is determined by an aversive pacing 
system. Extra-economic factors in industr)' usually have a more direct 
effect upon the behavior of the worker either in coming to work or 
in staying on one job. Quite apart from his rate of production while 
at work, the worker who “likes his job” shows little absenteeism and 
a histor)' of few changes of employment. He likes his job in the sense 
that he is reinforced for coming to work—not only by an effective 
wage schedule but by the conditions under which he works, by his 
fellow workers, and so on. He dislikes his job insofar as it has aversive 
properties. If he is kept at a high level of work through constant 
aversive stimulation in the form of a threat of dismissal, the whole 
task will become aversive and, when his economic condition permits, 
he will remain absent or, if possible, change jobs. Conditioned aver¬ 
sive stimuli associated with sickness, unemployment, or hardship in 
old age may also have important aversive effects. It does not help 
much in dealing with these problems to say that the employee wants 
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"freedom” or “security.” In the design of optimal working conditions, 
considered with respect not only to productivity but to absenteeism 
and labor turnover, we need an explicit analysis of actual reinforcing 

and aversive events. 

THE ECONOMIC VALUE OF LABOR 

That part of the behavior of the worker which is under economic 
control generates aversive stimuli-from the nature of the work itself 
or from the fact that it prevents the worker from engaging m activi¬ 
ties which would be reinforcing in other ways. Tliese aversive conse¬ 
quences are roughly offset by the economic reinforcement which the 
worker receives. When the worker accepts or rejects rtie offer of a )ob 
he may be said to be comparing positive and negative reinforcers. A 
similar comparison is made by the employer. Since those who use 
economic control must give up the goods or money with which they 
reinforce behavior, economic reinforcement is by definition aversive 

to the controller. • j- j i 

If these conflicting consequences are roughly equal, the 

may engage in behavior leading to a decision m the sense of Chapter 
XIV. sLll a man mow his own lawn or pay someone else to mow it 
for him? This will depend in part upon the aversive properties of mow¬ 
ing the lawn and the aversire properties of giving up the mon y 
needed to hire someone to mow it. It will also depend upon he 
behavior of making a decision in which the man may review other 
possible consequences of mowing the lawn himself-the exercise may 
L good for h.m-or the kinds of things for which the money which 
muft be paid could otherwise be exchanged, or ways in which he 
might earn that amount of money less aversively than by mowmg a 
lawn, and so on. The prospective employee may alter simdar condi¬ 
tions affecting his behavior in accepting or reiecting an offer. 

A “dear is made in such a case if in avoiding the aversive corrse- 
quences of mowing the lawn, the employer offers an amount equal to 
or greater than that which matches the aversive consequences to the 
IpToyee The amount offered will also depend upon the aversive 
con^seqLnces of giving up money. The amount offered by the em- 
^oyer^rwhat the job is “worth” to him in his current economic 
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circumstances; the amount accepted by the employee is what the job 
is “worth” to him in his current economic circumstances. 

The “economic value” of labor or other personal ser\aces thus has 
to do with the matching of positive and negative reinforcing effects. 
The reinforcing effects of two tasks could be directly compared, but 
money provides a single scale on which the economic values of many 
different types of labor or services may be represented. We have 
already seen that money has certain advantages as a generalized 
reinforccr; it has fairlv simple dimensions, it can be made contingent 
upon behavior in a clear-cut way, and its effects arc relatively free of 
the momentary condition of the organism. Money has a special 
advantage in representing economic value because different amounts 
can be compared on a single scale; one amount may be equal to 
another, twice as great as another, and so on. This standard scale is 
so effective in comparing rcinforcers that it is often taken to represent 
some sort of independent economic value not associated with positive 
or negative consequences. The monetary' scale is regarded as a pri- 
marv dimension of value. But the scale would have no meaning apart 
from the comparison of other consequences. 

I'o the employer the economic value of labor is just that amount of 
money which he will give up in return for that labor. This depends 
upon the results of the labor. We pay a man for mowing a lawn if a 
mowed lawn is reinforcing. We pay him for making shoes if shoes 
arc personally reinforcing or can be exchanged for money or goods 
which arc reinforcing for other reasons. Sometimes behavior itself is 
directly reinforcing, as in entertainment; we have seen that the enter¬ 
tainer is in the business of making his behavior positively reinforcing 
so that it will have economic value. 

To the employee the economic value of labor is just that amount 
of money for which he will supply that labor. The aversive conse¬ 
quences against which he places a value upon his services may be of 
many sorts. Hard labor is directly aversive, as is confinement at a 
given task for long periods of time regardless of the energy required. 
Some tasks are aversive for special reasons. Thorndike found that 
people were in general willing to name a price for engaging in a wide 
variety of aversive tasks—such as letting a snake coil around one’s 
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arms and head, eating a dead earthworm, or spitting on a picture of 
George Washington. Money which is paid for behavior which, 
although not especially aversive in itself, may possibly lead to pun¬ 
ishment, is usually called a bribe. The bribe supplies a measure of 
the economic value ot a given probability of punishment. 

Behavior has "nuisance value" when a man is paid for not engag¬ 
ing in it. W'hen a solicitous parent gives an allowance to his son so 
long as he docs not smoke or drink or mariA- before a given age, the 
behavior which the son foregoes may have substantial reinforcing 
properties for him. He "earns” his allowance by accepting the aver¬ 
sive consequences of giving up the stipulated reinforcements. When 
the behavior which is given up has no substantial reinforcing con¬ 
sequences but would be highly aversive to the man who pays to 
suppress it, the monev paid is referred to as blackmail. When the 
behavior is verbal-for example, testifying to or othcnvise reporting 
censurable behavior—it is commonly called hush money. A similar 
controlling relation is exploited by the undenvorld gang which sells 
“protection”—in other words, agrees not to damage person or prop¬ 
erty in return for payment. Blackmail and protection represent un¬ 
stable social systems in the sense of Chapter XIX. Such control is 
opposed by the ethical group or by religious and governmental 
agencies which make aversive consequences contingent upon engaging 

in such transactions. 

BUYING AND SELLING 

Buying and selling or exchanging in barter are so commonp^e 
that we are hkely to overlook several of the processes invo ved. The 
basic transaction or “deal” is expressed by the offer, I w.ll g.ve you 
this if you will give me that.” As in transactions involving personal 
labor, such complex stimuli are effective only after extensive eeo- 
riomic conditioning. The process is easy to observe as a chdd le^ns 
to swap toys with his playmates or to buy penny candy at the comer 
store. Before such behavior reaches a relatively stable state, the child 
must be affected by the full aversive consequences of giving up a ^y 
or a penny and by the reinforcing consequences of obtaining another 
toy or candy. When such conditioning has taken place, similar be 
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ior with similar objects and similar money may become relatively 
automatic, and it may be easy to overlook the complex relationships 
involved. Whether a sale is made quickly or after long deliberation 
depends upon whether the aversive properties of giving up money or 
going without the object are matched by the positively reinforcing 
properties of the monev or the object. In “a good bargain the ob,ect 
bought is more highlv reinforcing than the money given up, and the 
sale takes place quickly. In the doubtful bargain, positive and nega¬ 
tive consequences are relatively evenly matched, and the sale may 
take place only after long deliberation. 


'I he economic value of goods. The use of money in buying and 
selling permits us to evaluate goods as we evaluated labor—on a 
simple onc-dimcnsional scale. An object is “worth” to an individual 
just that amount of monev which he will give up in exchange for it, 
or in exchange for which he will give it up. Before an exchange or a 
sale can occur, certain critical values must be reached or exceeded. 
A will give the article to B if the aversive consequences of this 
act arc roughly matched bv the positively reinforcing consequences of 
the money which B will give to A. B will give this amount of money 
to A if the aversive consequences which are thus involved are matched 
by the positively reinforcing consequences of receiving the article 


from A. -C l, 

Several other conditions affect economic transactions. Since the 

money which a man will give in exchange for goods is a measure of 
the reinforcing effect of the goods, it will vary with the level of 
deprivation. The value which a man assigns to food depends upon 
how hungry' he is. By keeping food in short supply he may be induced 
to pay a high price. In the population as a whole this is reHected by 
the fact that the price commonly paid for an object can be manipu¬ 
lated by manipulating the supply. But how much a man will pay 
for food also depends upon the aversive consequences of giving up 
money, and this depends roughly upon how much money he has. 
If “money is no object,” he may pay a high price. In the population 
as a whole the price of an object will therefore be determined in part 
by the supply of money. These two factors, the supply of goods and 
the supply of money, have, of course, a prominent place in traditional 
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economic theor>-. They are not, however, the only determiners of 
economic transactions. 

An important consideration is the history' of reinforcement of the 
behavior of acquiring or gn ing up goods or money. The behavior of 
buying or selling niav be strengthened or weakened apart from the 
particular nature of a given transaction. W’hen the reinforcing con¬ 
sequences to the bu>er greatly exceed the aversive consequences of 
giving up fhe price of an article, the simple behavior of buying is 
Lengthened. In the technique of the bargain store some ob|ects are 
sold at a low price so that others, which are not bargains, can also be 
sold. The “biiving habits” of the public often reflect the same prin¬ 
ciple Whether an individual readily engages m buying also depends 
in part upon previous aversive consequences of giving up money. 
"Learning the value of a dollar” is the effect of the aversive conse¬ 
quences of parting with a dollar. 

^ The reinforcing effect of an article, and hence the price which can 
be obtained for it, is enhanced by many techniques of merchand.smg. 
The article is made "attractive” by design, packaging, and so on. 
Properties of this sort make an object reinforcing as soon as it is seen 
by the prospective purchaser, so that a previous history- with similar 

°^ImftaL7Lhavior is relevant in buying and selling. An ob|Cct may 
be bought simply because other people are buying objects of the same 
kind Ais is tL^principle of the bargain crush and the public spend- 

p„,.nt«l b„je. b, po.t*,in8 »«'» >>”>“ “ ° 

Imitative nonbuying is characteristic of periods of dcflatioi ^ 

The balaLing of positive and negatis e consequences may be offse 
by iering the rt-m/which elapses between these consequences and 
behavior Sales are encouraged by promises of immediate delnery^ 
The same effect is felt, in the absence of an agreement, when a mail 

by fllhng its orders as rapidly - possible gams an advan¬ 
tage over a rival house with a longer average delivery time. The be 
Sforr^ailing in an order is probably not, strictly 

bv the receipt of goods after, say, four days; any reinforcing effect o 
SeW consequent must be mediated by verbal or nonverbal inter- 
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veiling steps. But these intervening steps need not change the advan¬ 
tage gamed by reducing the tune which passes between the behavior 
and the ultimate consequence. Another kind of time relation is 
manipulated when the purchaser is permitted to buy on credit. In 
bin ing on the installment plan, the aversive consequences of giving 
up the purchase price arc postponed and distributed. The effect is to 
be distinguished from the effect of credit in permitting goods to be 

purchased before money is available. 

Another important factor contributing to the probability that an 
indisidual will turn over money, either for other money or for goods, 
is the schedule on which he is reinforced for doing so. A faulty vend¬ 
ing machine or dishonest vendor occasionally fails to complete the 
excliangc of goods for money. The probability of engaging in transac¬ 
tions under similar circumstances is to some extent reduced through 
extinction. However, if a vendor characteristically offers an especially 
good bargain whenever the transaction is completed, the probability 
mav remain at a significant value. In general, the greater the reinforc¬ 
ing effect of the object exchanged for money, the more often rein¬ 
forcements may fail without extinguishing the behavior altogether. 
This is an example of the type of economic interchange called 

gambling. 

One may gamble with money for money, as in playing a roulette 
wheel or slot machine; with money for goods, as in buying a chance 
on an automobile; or with goods for money, as in playing a customer 
double or nothing for the bill. The behavior of the gambler is under 
verj' complex control depending upon his historv' of reinforcement. 
It is sometimes possible to calculate the “chances” of a given gam¬ 
bling system, and these, if known to the gambler, may determine 
whether he will place a bet or not. How the probability that.a man 
will place a bet of a given size varies with such factors as the size of 
the stake or a given history of reinforcement can be studied experi- 
.nentally. The predisposition to continue betting under a given sys¬ 
tem, however, depends primarily upon the schedule of reinforcement. 
Gambling devices in general observ^e a v ariable-ratio schedule. From 
the point of view of the gambling establishment this is a safe sched¬ 
ule because the percentage profit in the long run is fixed. It is also an 
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unusually effective schedule in generating gambling behavior. Tlic 
gambling establishment selects a mean ratio which is a compromise 
between two consequences. Too high a ratio yields a large mean 
profit per play but a loss of patronage. Too low a ratio yields too 
small a profit in spite of a ready patronage. The professional gambler 
"leads his victim on’’ by building a favorable histor^^ of reinforce¬ 
ment. He begins with a low mean ratio under which reinforcement 
occurs so frequently that the victim wins. The mean ratio is then 
increased, cither slowly or rapidly depending upon how long the 
gambler plans to work with a particular victim. This is precisely the 
way in which the behavior of a pigeon or rat is brought under the 
control of a variable-ratio schedule. A mean ratio can be reached at 
which reinforcements occur so rarely that the pigeon or rat spends 
more energ}' in operating the device than he receives from the rein¬ 
forcement with food, while the human subject steadily loses money. 
All three subjects, however, continue to play. 

Gambling devices make an effective use of conditioned reinforcers 
which are set up by pairing certain stimuli with the economic rein¬ 
forcers which occasionally appear. For example, the standard slot 
machine reinforces the player when certain arrangements of three 
pictures appear in a window on the front of the machine. By paying 
off vet)' generously—with the jack pot—for three bars, the device 
eventually makes two bars plus any other figure strongly reinforcing. 
“Almost hitting the jack pot” increases the probability that the indi¬ 
vidual will play the machine, although this reinforcer costs the owner 

of the device nothing. 

Gambling, then, is a system of economic control in which the indi¬ 
vidual is induced to pay money in return for a reinforcement the 
value of which is too small to lead to exchange under other sched¬ 
ules. If a man cannot sell a car to one man for $3,000, he may still sell 
it to 3,000 men for $1.00 if the culture has provided the necessary his¬ 
tory of variable-ratio reinforcement when its members have “taken 
chances.” If the gambling establishment cannot persuade a patron to 
turn over money with no return, it may achieve the same effect by 
returning part of the patron’s money on a variable-ratio schedule. 

In summar)’, then, the probability that a transaction will take place 
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is a function of the levels of deprivation of buyer and seller with 
respect to goods and money, upon the history of both participants 
witli respect to good and bad bargains, upon the temporary charac¬ 
teristics of the object or the situation involved in merchandising, 
upon the behavior of others engaged in similar transactions, upon 
the temporal contingencies which govern the receipt of goods or the 
giving up of money, and upon a history of certain schedules of rein¬ 
forcement. All these conditions follow from an analysis of human 
behavior; they are also familiar features in traditional discussions of 
economic behavior. They obviously affect the usefulness and preci¬ 
sion of the concept of economic value. The reinforcing effect of 
cither goods or money cannot be stated without talcing into account 
many different characteristics of the history of the individual buyer 
or seller, as well as the external circumstances under which a given 
economic transaction takes place. 

FCONOMICS" 

When millions of people engage in buying and selling, lending and 
borrowing, renting and leasing, and hiring and working, they gener¬ 
ate the data which are the traditional subject matter of the science of 
economics. The data include the quantities and locations of goods, 
labor, and money, the numbers of economic transactions in a given 
period, certain characteristics of transactions expressed as costs, prices, 
interest rates, and wages, together with changes in any of these as 
functions of time or other conditions. 

Statements about goods, money, prices, wages, and so on, are often 
made without mentioning human behavior directly, and many im¬ 
portant generalizations in economics appear to be relatively inde¬ 
pendent of the behavior of the individual. A reference to human 
behavior is at least implied, however, in the definition of all key 
terms. Physical objects are not goods apart from their reinforcing 
value. More obviously, money cannot be defined without reference to 
its effect upon human behavior. Although it may be possible to dem¬ 
onstrate valid relationships among the data generated by the eco¬ 
nomic transactions of large numbers of people, certain key processes 
in the behavior of the individual must be considered. The traditional 
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procedure has been to deduce the behavior of the individual engag¬ 
ing in economic transactions from the data derived from the group. 
This procedure led to the Economic Man of nineteenth-century eco¬ 
nomic theory, who was endowed with just the behavior needed to 
account for the over all facts of the larger group. This explanatory 
fiction no longer plays a prominent role in economic theorizing. 

Some attention to the individual transaction is often required when 
generalizations at the level of the group prove invalid. We have 
already noted many special conditions which affect economic value. 
In the data generated by millions of people the effects of these spe¬ 
cial conditions may strike an average or cancel each other out. But 
when a given condition holds for a large number of people, it cannot 
be disposed of in this way. Economists frequently explain the failure 
to predict a particular consequence from a broad generalization by 
appealing to special conditions of this sort. Although the supply of 
money and goods may suggest inflation, for example, some external 
condition, not otherwise related to the supply of money or goods, 
may generate undue caution on the part of a large number of buyers. 
If the science of economics were to take all such extra-economic 
variables into account, it would become a complete science of human 
behavior. But economics is concerned with only a small number of 
the variables of which the behavior of the individual is a function. 
There are many practical reasons why this limited area needs to be 
studied in relative isolation. This means that the economist w.l 
always need to appeal from time to time to the behavior of the real 

Economic theory has been especially inclined to use the principle 
of maxima and minima. The freedom, justice, and security of the 
governmental agency, the salvation and piety of the religious agency, 
and the mental health and adjustment of psychotherapy have their 
parallels in “wealth,” “profits.” “utility.” and many other concepts 
in terms of which economic transactions have been evaluated. Since 
quantification is encouraged in economic theorizing by the useful 
dimensions of money as a generalized reinforcer, it may appear that 
these entities are more easily adapted to a functional analysis. But it 
has not been shown that they are, in fact, any more useful in pre- 
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dieting or controlling a given economic transaction than are their 
counterparts in the other fields. The conception of economic behav¬ 
ior which emerges from a functional analysis offers an alternative 
possibility. I'hc present chapter has, of course, dealt with only a small 
fraction of the nianv kinds of economic transactions to be obsers'cd 
ui anv large group of people, but an adequate science of behavior 
should supply a satisfactory’ account of the individual behavior which 
is responsible for the data of economics in general. 


I MK KCONOMIC AGENCY 

riic power to wield economic control naturally rests with those 
who possess the neccssar>' money and goods. The economic agency 
may consist of a single individual or it may be as highly organized 
as a large industr\-. foundation, or even government. It is not size or 
structure which defines the agency as such, but the use to which the 
economic control is put. The individual uses his wealth for personal 
reasons, which may include the support of charities, scientific activi¬ 
ties. artistic enterprises, and so on. Tlie eleemosynary foundation is 
engaged in disposing of wealth in support of specified activities. 
Religious and governmental agencies frequently, as we have seen, use 
this supplemental^' technique for their special purposes. 

If there is any special economic agency as such, it is composed of 
those who possess wealth and use it in such a way as to presers'e or 
increase this source of power. Just as the ethical group is held to¬ 
gether by the uniformity of the aversive effect of the behavior of the 
individual, so those who possess wealth may act together to protect 
wealth and to control the behavior of those who threaten it. To that 
extent we may speak of the broad economic agency called “capital.” 
The study of such an agency requires an examination of the prac¬ 
tices which represent concerted economic control and of the return 
effects which support these practices. 


COUNTERCONTROL 

As in religious, governmental, or psychotherapeutic control, eco¬ 
nomic power may be used to further the special interests of those 
who possess it. Excessive control generates behavior on the part of 
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the controllee which imposes a practical limit. The group as a whole 
usually condemns the excessive use of wealth as bad or wrong, and 
classifies the charitable use of wealth as good or right. Some counter- 
control is also exerted bv religious and governmental agencies. Under 
most modern governments, for example, tlic individual cannot legally 
control many sorts of behavior through economic power. Laws con¬ 
cerning prostitution, child labor, fraudulent practices, gambling, and 
so on all impose limits. Particular economic transactions arc re¬ 
stricted, or rendered more or less probable, by tariffs, levies, taxes on 
profits and on transactions, price controls, changing the supply of 
money, govemment spending, and so on. All these measures alter the 
balance between those possessing labor or goods and those possessing 
money; hence they alter the frequency with which certain kinds of 
economic transactions take place. The effect is usually to reduce the 
extent to which the possessor of wealth is able to employ it in con¬ 
trolling others. 



CHAPTER XXVI 


EDUCATION 


In an American school if you ask for the salt in good French, 
you get an A. In France you get the salt. The difference reveals the 
nature of educational control. Education is the establishing of behav¬ 
ior which will be of advantage to the individual and to others at some 
future time. The behavior will eventually be reinforced in many of 
the ways we have already considered; meanwhile reinforcements are 
arranged by the educational agency for the purposes of conditioning. 
The reinforcers it uses are artificial, as such expressions as ''drill,” 

“exercise,” and “practice” suggest. 

Education emphasizes the acquisition of behavior rather than its 
maintenance. Where religious, governmental, and economic control 
is concerned with making certain kinds of behavior more probable, 
educational reinforcement simply makes special forms more probable 
under special circumstances. In preparing the individual for situa¬ 
tions which have not as yet arisen, discriminative operants are 
brought under the control of stimuli which will probably occur in 
these situations. Eventually, noneducational consequences determine 
whether the individual will continue to behave in the same fashion. 
Education would be pointless if other consequences were not even¬ 
tually forthcoming, since the behavior of the controllee at the 
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moment when he is being educated is of no particular importance 
to any one. 

EDUCATIONAL AGENCIES AND THEIR 
TECHNIQUES OF CONTROL 

The immediate family functions as an educational agency in teach¬ 
ing the child to walk, to talk, to play, to cat in a given way, to dress 
himself, and so on. It uses the primary' rcinforcers available to the fam¬ 
ily: food, drink, and warmth, and such conditioned rcinforcers as 
attention, approval, and affection. The family sometimes engages in 
education for obvious reasons—for example, because the child is con¬ 
verted into a useful member. The “pride” which a parent takes in the 
achievements of his children does not provide an explanation, since 
the term simply describes the fact that the achievement of a child 
is reinforcing. This fact appears to depend upon the culture. The 
individual continues to receive many forms of casual instruction from 
members of the group outside his family, where the variables available 
to the group arc similar to those in ethical control (Chapter XXI). 
Certain forms of behavior are classified as good or right and others as 
bad or wrong and arc reinforced accordingly. It is not always clear 
why this is done, however. An extension of ethical control to educa¬ 
tion may, like family pride, have special advantages for the group, in 
which case it can be explained only through an analysis of cultural 
practices (Section VI). 

The artisan teaches an apprentice because in so doing he acquires 
a useful helper, and industries teach those who work for them for a 
similar reason. The rcinforcers are usually economic. When a govern¬ 
ment engages in military training to improve the efficiency of its 
armed forces, the techniques are usually based upon punishment or 
the threat of punishment. When religious agencies turn to educa¬ 
tion to supplement other techniques, they also use the variables pecu¬ 
liarly under their control. The educational agency, then, is not dis¬ 
tinguished by the nature of its variables but in the use to which they 
are put. There is a difference between the use of economic power to 
induce an apprentice to work and to induce him to acquire effective 
forms of behavior, between the use of the threat of punishment to 
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induce a soldier to fight and to induce him to fight efFectively, and 
between the use of the power peculiarly available to the religious 
agency to reinforce pious behavior and to teach a catechism. 

I’hc educational institution. A more explicit educational agency 
requires special treatment. Education is a profession, the members of 
which engage in education primarily because of economic reinforce¬ 
ment. As in many other professions, reinforcements supplied by the 
ethical group are also often important: teaching is not only a way 
of earning a living, it is "a good thing to do.” In explaining the pres¬ 
ence of educational institutions in a given community, then, we have 
to explain the behavior of those who pay for or approve those who 
teach. What is received by them in return? 

The private tutor extends family education, and the family pays for 
his scr\iccs for the same reason it educates its children directly. The 
private school is a collaborative effort of the same sort. Religious or 
trade schools arc similar extensions of the activities of other agencies. 
In explaining public education, certain immediate benefits to the 
group as a whole may be pointed out. The lower grades of the public 
schools take over the educational function of the family, supervise 
the children during part of the day, generate behavior which is useful 
to the family and the community and which permits the family to 
escape censure. Comparable results from the education of older chil¬ 
dren are not always clear, and this fact raises a practical as well as a 
theoretical difficulty. The explicit educational agency is not found in 
every culture, and the extent to which a given group supports it may 
vary widely from time to time. When those who supply the ultimate 
power, economic or other^vise, do not receive sufficient reinforcement 
for doing so, they withdraw their support. Yet educators seldom at¬ 
tempt to increase the return benefits or to make them more effective 
as reinforcers. 

Aside from any immediate return we have to note the possible 
long-term effect of education. Like family pride or education by 
members of the group, the explicit educational institution may be 
explained by a different sort of consequence to the group to be con¬ 
sidered in Section VI. 
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EDUCATIONAL REINFORCEMENT 

The reinforcers used bv established educational institutions arc 
familiar: they consist of good grades, promotions, Phi Beta Kappa 
keys, diplomas, degrees, and medals, all of which are associated with 
the generalized reinforccr of approval. The spelling bee is a familiar 
device which makes approval or other social rcinforcers explicitly 
contingent upon scholastic behavior. The same technique is repre¬ 
sented by modern quiz programs in which “knowledge is reinforced 
for its own sake.” A certain exchange value is evident when the 
recently educated individual is offered a job or is automatically ad- 
mitted to membership in certain controlling groups. The educational 
agency usually wields no economic power itself, however, except for 
prizes, fellowships, and scholarships. Some rcinforcers may be avail¬ 
able in the form of privileges. The institution may also have the 
support of the family which makes primary or conditioned rcinforcers 
contingent upon a level of scholastic achievement—for example, by 
granting a special allowance to the student who maintains a certain 
average. During World War II some militar\^ education was taken 
over by educational institutions, and a new and important rcinforcer 
then became available to the teacher in the form of militar>' advance¬ 
ment. 

The venerable place of punishment in educational control is rep¬ 
resented by the birch rod and the cane, as well as by the condoning 
of certain forms of disciplinary \'iolcnce—for example, hazings. Ex¬ 
treme forms of physical punishment have now been generally aban¬ 
doned, but we have noted the general rule that when one aversive 
consequence is dropped, another is often created to take its place. 
Just as wages paid on a fixed-inter\al schedule may eventually be used 
to supply aversive stimulation in the form of a threat of dismissal, so 
the teacher of small children who does not spank may nevertheless 
threaten to withdraw approval or affection in a form of aversive con¬ 
trol. In the same way, the positive reinforcers available to schools and 
colleges are often used as the basis for conditioned aversive stimula¬ 
tion in the form of a threat of failure or dismissal. 

By-products of control through punishment have always been con- 
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spicuoiis features of educational institutions. Hell-raisings, riots, 
hazings, and truancy are forms of counteraggression or escape which 
follow the analysis of Chapter XXIV. Somewhat more neurotic by¬ 
products are common. The advantages to be gained in turning to 
other tcclmiques of control arc therefore obvious. But one mode of 
control cannot be given up until something else is ready to take its 
place, and there is evidence that the educational institution at the 
moment lacks adequate control. Not only has the educator relin¬ 
quished the birch rod; he can no longer borrow discipline from family 
practices based on aversive control. As more and more people are 
educated, the honorific reinforcements of education are weakened, 
fewer special advantages are now contingent upon education. With 
increasing social security the economic consequences of an education 
arc also less important; relatively fewer students are out to “make 
good" in amassing wealth or at least in escaping the threat of a desti¬ 
tute old age. 

Educational institutions have, therefore, turned to alternative 
methods of control. The teacher, often unwillingly, uses the sources 
of power available to him in personal control to make himself or his 
teaching interesting; in other words, he becomes an entertainer. Text¬ 
books are supplied with pictures and diagrams which resemble expo¬ 
sitions of the subject matter in magazines or the press, and lectures 
are supplemented with demonstrations and “visual aids.” Especially 
favorable circumstances for the execution of the behavior to be con¬ 
trolled by the educational institution are arranged: libraries are 
designed to make books more readily accessible, laboratories are 
expanded and improved, facilities are provided for field trips and 
periods of study in especially favorable locations. Subjects which are 
not easily adapted to these techniques are often minimized or dis¬ 
carded. 

The term “progressive education” roughly describes a concerted 
effort to find substitutes for the spurious reinforcements of educa¬ 
tional control. Consequences of the sort which will eventually govern 
the behavior of the student are brought into the educational situa¬ 
tion. Under the traditional system the student who is reinforced for 
speaking French correctly by an A is eventually reinforced, if at all. 
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when he enjoys books written in French or communicates effectively 
in a French-speaking community. In progressive education, these 
“natural” or “functional” reinforcements are employed by the edu¬ 
cational agency as soon as possible. Similarly, the student who is 
studying science is reinforced as soon as possible by his increasing 
competence in dealing with nature. By pcmiitting a wider choice of 
what is to be studied, the probability is increased that scholastic 
behavior will receive such noneducational reinforcement at an early 
date. It has perhaps always been characteristic of good education to 
introduce “real” consequences, but progressive education has made 
an effort to do this as often and as soon as possible. A common objec¬ 
tion has been that certain fields of study are thus unduly emphasized 
at the expense of others in which disciplinary training with merely 
educational reinforcement cannot be avoided. 

The conditioned reinforcers of the educational agency may be 
made more effective by pointing up the connection with natural con¬ 
tingencies to be encountered later. By informing the student of the 
advantages to be gained from education, education itself may be 
given reinforcing value. Many educational institutions have there¬ 
fore turned to counseling and various forms of therapy as auxiliary 

techniques. 

THE BEHAVIOR RESULTING FROM 
EDUCATIONAL CONTROL 

When educational reinforcements are made contingent upon topo¬ 
graphical or intensive properties of behavior, the result is called skill. 
The differentiation discussed in Chapter VI is characteristic of train¬ 
ing in painting, music, handwriting, speaking, sports, and crafts. The 
noneducational reinforcements which eventually take control are the 
special consequences of skilled behavior. In teaching a man to play 
tennis some such educational reinforcer as the verbal stimulus 
“Good!” or “That’s right!” is made contingent upon the proper gnp, 
the proper stroke, the proper timing, and so on. The resulting good 
form” is eventually maintained by the natural consequences of the 
flight of the ball. Similarly, the educational reinforcement of good 
technique in painting is eventually replaced by the production of 
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pictures which are in themselves reinforcing. Technical skill in the 
operation of tools and machines leads first to the approval of the 
instructor and then to the successful production of objects which are 

reinforcing. 

Knowledge. The entity which is traditionally said to be maximized 
by education is called “knowledge.” The term refers to some of the 
most complex kinds of human behavior, and it is therefore not sur¬ 
prising that it has seldom been clearly defined or effectively em¬ 
ployed in evaluating educational practices. We sometimes use the 
term to represent simply the probability of skilled behavior. A man 
“knows how to write” in the sense that he possesses behavior with 
pen and paper which will be emitted under suitable circumstances 
and will generate certain kinds of marks. In a similar sense he knows 
how to hit a tennis ball or sing a tune or draw a straight line. Usually, 
however, knowledge refers to a controlling relation between behavior 
and discriminative stimuli. The response may be skilled, but we are 
concerned primarily with whether it will be made upon the proper 
occasion. 'I’hus, skilled movements are needed in driving a car, but 
knowing how to drive a car is making the proper responses at appro¬ 
priate times. One knows how to repair a radio in the sense, not of 
being able to manipulate pliers, screw driver, and soldering iron, but 
of manipulating them in appropriate places. 

Most knowledge acquired in education is verbal. The stimuli which 
constitute the appropriate occasions may be verbal or nonverbal. A 
child “knows the alphabet,” not because he can pronounce the names 
of the letters, but because he can do so in the proper order. One 
letter or group of letters is the occasion for pronouncing the letter 
which follows. He “knows the capital of Peru” in the sense that he 
will correctly answer when asked what the capital is or will make 
statements about the capital in discussing Peru, and so on. A man 
“knows his table of integrals” in the sense that under suitable cir¬ 
cumstances he will recite it, make corresponding substitutions in the 
course of a calculation, and so on. He “knows his history” in the 
sense of possessing another highly complex repertoire. In rare in¬ 
stances parts of the historical repertoire are controlled by nonverbal 
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stimuli—the primar)' data of histon'; but historical knowledge is 
largely verbal behavior in response to verbal stimuli. The repertoire 
is useful primarily when the individual is in contact with other indi¬ 
viduals possessing similar knowledge. In other kinds of knowledge, 
particularly in science, a greater part of the discriminative stimuli 
may be nonverbal, and the repertoire is useful primarily in enabling 
the individual to act effectively with respect to nature. Wc need not 
regard such repertoires as “signs” of knowledge but rather as knowl¬ 
edge itself. Knowledge enables the individual to react successfully to 
the world about him just because it is the very behavior with which 
he does so. 

The contention that a knowledge of histor)', for example, is simply 
a verbal repertoire does not mean that education is merely rote learn¬ 
ing. The student comes also to understand the facts of histoiy'. An 
adequate explanation of what this means would require an exhaustive 
analysis of verbal behavior which cannot be given hcre.^ The indi¬ 
vidual agrees with a statement about a historical event in the sense 
that he shows a high probability of making the statement himself. 
The growing understanding with which he reads and rereads a pas¬ 
sage describing a period in histor)^ may also be identified with the 
growing probability that he will emit verbal responses similar to those 
which comprise the passage. But the high probability which charac¬ 
terizes agreement or understanding may have many sources; knowl¬ 
edge of a given field is coherent and well integrated to the extent that 
these multiple sources of strength are generally consistent. So far as 
the present point is concerned, we may note simply that the supple¬ 
mentary' sources of strength which distinguish understanding from 
“tending to say” do not require us to modify the view that knowl¬ 
edge is a repertoire of behavior. Understanding is a collateral issue 
which concerns the variables of which such a repertoire is a function. 

A verbal repertoire also gains importance from the fact that it may 
have collateral effects upon other behavior of the individual. One 
such effect is most easily observed when the verbal repertoire and the 
change in behavior are located in different organisms. The speaker 

* Cf. footnote on page 210. 
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has many effects upon the listener. One of these may conveniently be 
called “instruction.” The verbal stimulus generated by the speaker 
alters the probability of a verbal or nonverbal response in the listener 
Let us assume, for example, that a man is familiar with electrical 
apparatus and possesses a set of avoidance responses controlled by 
parts of such an apparatus which are electrically charged or hot^ 
In working with a new piece of apparatus, he acquires, perhaps apart 
from any verbal instruction, appropriate avoidance behavior with 
respect to certain features. Hie process is naturally aversive and may 
not be necessary if the individual is instructed in the use of the ap¬ 
paratus When he is told, for example, that certain terminals are hot, 
he avoids them even though he has not received aversive stimulation 
from them. But the process of being told is complex. The instruction 
involves the pairing of two stimuli-a complex verbal stimulus gen¬ 
erated as the speaker says “this terminal” and points to a part of the 
apparatus and the verbal stimulus “hot.” The occurrence of these 
stimuli together has an effect similar to that of respondent condition¬ 
ing; the object identified as “this terminal” subsequently evokes the 
avoidance behavior appropriate to objects designated “hot.” As we 
observe in the behavior of children, the capacity to be affected by 

verbal behavior in this way develops only very slowly. 

An educational institution often directly instructs the student in this 
sense, but it usually functions by establishing a complex verbal reper¬ 
toire which the student later uses in what may be called self-instruc¬ 
tion. The speaker and the listener now inhabit the same skin. Upon 
a given occasion verbal behavior is evoked which instructs the student 
himself in nonverbal behavior. In a simple example, the student 
memorizes a set of instructions and then later correctly operates the 
device to which they are appropriate. In a far more complex example, 
he acquires an extensive historical repertoire and then deals effectively 
with a current situation when some of the responses in that reper¬ 
toire instruct him appropriately. 

If we take knowledge to include not only a repertoire as such, but 
all the effects which the repertoire may have upon other behavior, 
then the acquisition of knowledge in education is obviously far more 
than rote learning. Moreover, the educational institution does more 
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than impart knowledge even in this broad sense. It teaches the stu¬ 
dent to think, in the sense of Chapter XVI. It establishes a special 
repertoire which has as its effect the manipulation of variables which 
encourage the appearance of solutions to problems. The student 
learns to observe, to assemble relevant materials, to organize them, 
and to propose tentative solutions. Such a practice is essential in pre¬ 
paring him for some kinds of future occasions. We saw that the 
ethical group and religious and governmental agencies cannot simply 
establish good, pious, or legal forms of behavior, but must also set up 
processes of self-control which will enable the individual himself to 
arrive at good, pious, or legal behavior on novel occasions in the 
absence of members of the group or agency. In the same way the edu¬ 
cational institution cannot be content merely with establishing 
standard repertoires of right answers but must also establish a 
repertoire with which the student may, so to speak, arrive at the right 
answer under novel circumstances in the absense of any representa¬ 
tive of the agency. 


COUNTERCONTROL 

Since the power over variables available to the educational institu- 
tion is in general weak, we might not expect to find that it is often 
misused or that anyone is interested in countercontrol. There are, how¬ 
ever several ways in which the control exercised by the educator is 
commonly restricted. An educational institution is usually set up and 
supported in terms of a particular curriculum A child is sent to a 
particular school largely because of what the school will t^ch Those 
who are in ultimate control-for example, those who supply the insti¬ 
tution with money-may insist that the curriculum be closely fol¬ 
lowed. The college supported by a religious agency engages in appro¬ 
priate religious instruction and must not establish behavior opposed 
to the interests of the agency. Schools supported by a government 
may be asked to apply their educational techniques in supporting the 
government and to avoid any education which conflicts with gov- 
Lmental techniques of control or threatens the sources of govern- 

mental power. 
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Since other types of agencies also engage in educational control, 
they often enlist the services of the educational institution. Economic 
and religious agencies sometimes supply materials for school use which 
encourage education in line with economic or religious control. It 
may be necessar>' for a governmental agency to restrict the extent to 
which public schools serve other agencies in this way. 



SECTION 



THE CONTROL OF 

HUMAN BEHAVIOR 



chapter XXVII 


CULTURE AND CONTROL 


MANNERS AND CUSTOMS 

In addition to the ethical behavior discussed in Chapter XXI 
the individual acquires from the group an extensive repertoire of 
manners and customs. What a man eats and drinks and how he does 
so, what sorts of sexual behavior he engages in, how he builds a house 
or draws a picture or rows a boat, what subjects he talks about or 
remains silent about, what music he makes, what kinds of personal 
relationships he enters into and what kinds he avoids—all depend in 
part upon the practices of the group of which he is a member. The 
actual manners and customs of many groups have, of course, been 
extensively described by sociologists and anthropologists. Here we are 
concerned only with the kinds of processes which they exemplify. 

Behavior comes to conform to the standards of a given community 
when certain responses are reinforced and others are allowed to go 
unreinforced or are punished. These consequences are often closely 
interwoven with those of the nonsocial environment. The way m 
which a man rows a boat, for example, depends in part upon certain 
mechanical contingencies; some movements are effective and others 
ineEEective in propelling the boat. These contingencies depend upon 
the construction of the boat and oars—which are in turn the result 
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of otlicr practices obseiA'ed by the boatmakers in the group. Tliey 
also depend upon the type of water, which may be peculiar to a group 
for geographical reasons, so that the manner in which a boat is rowed 
in an inland lake district is different from that along the seacoast 
even when boat and oars are of the same type. The educational con¬ 
tingencies established by the group are still another source of differ¬ 
ence. Tlic individual is reinforced with approval when he adopts cer¬ 
tain grips, postures, kinds of strokes, and so on, and punished with 
criticism when he adopts others. These variables are especially im¬ 
portant in determining the “style” which eventually becomes char¬ 
acteristic of a group. 

The contingencies to be observed in the social environment easily 
explain the behavior of the conforming individual. The problem is to 
explain the contingencies. Some of these are arranged for reasons 
which have no connection with the effect of customs or manners 
upon the group. The community functions as a reinforcing environ¬ 
ment in which certain kinds of behavior are reinforced and others 
punished, but it is maintained as such through other return benefits. 
Verbal behavior is a good example. In a given community certain 
vocal responses are characteristically reinforced with food, water, and 
other services or objects. These responses become part of a child's 
repertoire as naturally as nonverbal responses reinforced by the same 
consequences. It does not greatly matter whether a child gets a drink 
by bending over a pool or by saying, “I want a drink of water.” To 
explain why the water is forthcoming in the latter case, however, 
requires a rather elaborate analysis of the verbal environment. It is 
enough to note here that a verbal environment may maintain itself 
through its effects upon all participants, quite apart from its func¬ 
tion in teaching the language to new members of the community. 
An adult in a new verbal environment may receive no explicit edu¬ 
cational reinforcement but may nevertheless acquire an adequate 
vocabulary. Some nonverbal customs and manners can be explained 
in the same way. Moreover, when a custom is perpetuated by a gov¬ 
ernmental, religious, or educational agency, we may point to the 
usual return benefits. 

But there remains the fact that the community as a whole often 
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establishes confomiing behavior tlirough what are essentially educa¬ 
tional technicjiies. Over and above the reciprocal reinforcements 
which sustain verbal behavior, for example, tlie coninuinitv extends 
the classification of “right” and “wrong” to certain forms of that 
behavior and administers the generalized reinforcements of approval 
and disapproval accordingly. In many groups a mistake in grammar 
or pronunciation is followed by more aversive consequences than, 
say, minor instances of lying or stealing. "I’hc group also supports 
educational agencies which supplv additional consccjucnces working 
in the same direction. But why is such deviant behavior aversive? 
Why should the group call an ungrammatical response “wrong” if 
the response is not actually ambiguous? W'hy should it protest uncon¬ 
ventional modes of dress or rebuke a member for unconventional 
table manners? 

One classical answer is to show that a given form of deviant be¬ 
havior must have been a\ersive for good reason under an earlier 
condition of the group. Foodstuffs arc in general selected by con¬ 
tingencies which follow from their physical and chemical properties. 
Foods which are unpalatable, inedible, or poisonous come to be left 
alone. A child who starts to cat such a food receives powerful aver¬ 


sive stimulation from the group. 


“Good” and “bad” foods arc even¬ 


tually specified in ethical, religious, or governmental codes. When, 
now, through a change in climate or living conditions, or as the 
result of changing practices in the preparation and preservation of 
food, a “bad” food becomes safe, the classification may nevertheless 
survive. There is no longer any current return advantage to the group 
to explain why eating a particular food is classified as bad. I’he clas¬ 
sification may be especially puzzling if the group has meanwhile 


invented an explanation for it. 

We may also show indirect, but presumably none the less effective, 
current consequences. In his Theory of the Leisure Class^ Tiiorstein 
Veblen demonstrated that customs or manners which seemed to have 


no commensurate consequences, and which were explained in terms 
ot doubtful principles of beauty or taste, had an important effect 
upon other members of the group. According to Veblen we do not 
necessarily wear “dress” clothes or speak useless languages because 
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the clothes are beautiful or the languages “cultured,” but because we 
are then accepted by a group in which these achievements are a mark 
of membership and because we gain prestige in controlling those 
who are unable to bebave in the same way. According to this theory, 
a modern American university builds Gothic buildings not because 
the available materials resemble those which were originally re¬ 
sponsible for this style of architecture, or because the st) le is beautiful 
in itself, but because the university then commands a more extensive 
control by resembling medieval educational institutions. The prac¬ 
tices of the group which perpetuate a “good” style of architecture are 
thus as easy to explain as those which perpetuate modes of construc¬ 
tion which are “good” for mechanical reasons. 

Perhaps the simplest explanation of the differential reinforcement 
of conforming behavior is the process of induction. The forces which 
shape ethical behavior to group standards are powerful. TTie group 
steps in to suppress lying, stealing, physical assault, and so on, because 
of immediate consequences to its members. Its behavior in so doing 
is eventually a function of certain characteristic features of the “good” 
and “bad” behavior of the controlled individual. Among these is lack 
of conformity to the general behavior of the group. There is thus a 
frequent association of aversive properties of behavior with the prop¬ 
erty of nonconformance to a standard. Nonconforming behavior is 
not always aversive, but aversive behavior is always nonconforming. If 
these properties are paired often enough, the property of noncon¬ 
formance becomes aversive. “Right” and “wrong” eventually have the 
force of “conforming” and “nonconforming.” Instances of behavior 
which are nonconforming but not otherwise aversive to the group 
are henceforth treated as if they were aversive. 

No matter how we ultimately explain the action of the group in 
extending the ethical classification of “right” and “wrong” to manners 
and customs, we are on solid ground in observing the contingencies 
by virtue of which the behavior characteristic of a particular group is 
maintained. As each individual comes to conform to a standard pat¬ 
tern of conduct, he also comes to support that pattern by applying 
a similar classification to the behavior of others. Moreover, his own 
conforming behavior contributes to the standard with which the 
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behavior of others is compared. Once a custom, manner, or style has 
arisen, therefore, the social system which observes it appears to be 

reasonably self-sustaining. 

THE SOCIAL ENVIRONMENT 
AS CULTURE 

A social environment is usually spoken of as the “culture” of a 
group. The term is often supposed to refer to a spirit or atmosphere 
or something with equally nonphysical dimensions. Our analysis o 
the social enviroment, however, provides an account of the essentia 
features of culture within the framework of a natural science. It 
permits us not only to understand the effect of culture but, as we 

shall see later, to alter cultural design. . , , 

In the broadest possible sense the culture into which an individual 

is born is composed of all the variables affecting him which are ar¬ 
ranged by other people. The social environment is in part the result 
of those practices of the group which generate ethical behavior and 
of the extension of these practices to manners and customs. It is in 
part the accomplishment of all the agencies considered m Section V 
Ld of various subagencies with which the individual may be m espe¬ 
cially close contact. The individual’s family, for example, may cont 
him through an extension of religious or govermnental techniques, by 
way of psychotherapy, through economic control or as an 
insUtut^n. The special groups to which he 

group or street gang to adult social ^ ; 

larticular individuals may also exert special forms ° 

ture, m this broad sense, is thus enormously complex and extrao 

™«.,. in ."1 l.-S" >'■“ *7 

,™iw otoeJ coittasenae. of confol. Di.ofeeol efoo.. o~<i 



420 THE CONTROL OF HUMAN BEHAVIOR 

is charactcristicall)- divided among many groups which wield their 
power in different ways. 

A given social environment may change extensively in the lifetime 
of a single individual, who is then subjected to conflicting cultures. 
In America, important changes have recently taken place in the tech¬ 
niques used to control sexual behavior. The unmarried female was 
formerly subjected to strict control by the ethical group and by gov¬ 
ernmental, religious, and educational agencies. Access to the world 
at large was forbidden or permitted only in the company of a chap¬ 
eron who might use physical restraint if necessary. Stimuli leading to 
sexual behavior were, so far as possible, eliminated from the imme¬ 
diate environment. The anatomy and physiolog)' of reproductive 
organs, particularly of the male, remained obscure, and any behavior 
which might alter this condition was severely punished. Such punish¬ 
ment, supplemented by other procedures, generated behavior which 
reflected “purity" or “modesty” as a form of self-control. Facts related 
to sexual behavior which could not be concealed were explained in 
fictitious ways. Incipient sexual behavior was, of course, severely 
punished, not only with aversive stimulation, but with such powerful 
conditioned punishments as disapproval, shaming, and threats of 
ostracism. As a result any incipient sexual behavior gave rise to aver¬ 
sive self-stimulation. 'Hiis provided for the reinforcement of further 
acts of self-control and elicited emotional responses with which sexual 
behavior was incompatible. 

Such severe measures could be justified only by arguing that sexual 
behavior was wrong, that it was nevertheless very' powerful, and that 
aggressive sexual behavior on the part of the male must be met with 
exceptional defenses on the part of the female. There were often 
objectionable by-products, however. Although the control was in¬ 
tended to apply mainly to premarital sexual behavior, the effect com¬ 
monly extended into the marital state, and the individual was pre¬ 
vented from enjoying sexual relations in a normal fashion. The 
resulting repression of sexual impulses had many of the neurotic effects 
outlined in Chapter XXIV—from perverted sexual activity to the 
behavior of the common scold. These consequences, doubtless in com¬ 
pany with many other factors, led to a substantial change in practice. 
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The modern version of sexual control is ver\- different. Although 
there is no one clearly formulated program, it is recognized that 
anxiety with respect to sexual belunior is unnccessaiy. Instead of 
removing from the environment all stimuli which could possibly lead 
to sexual behavior, a knowledge of tlic anatomy and function of sex 
is supplied. Friendly relations with the opposite sex arc more freely 
permitted, and severe punishment of sexual behavior is avoided in 
fa\or of instruction in the consequences of such behasior. It is pos¬ 
sible that these techniques are not so effectise as earlier measures. 
Sexual behavior is probably not so deeply repressed, and it is also 
probably commoner at the overt level. The net result may or may not 
be to the advantage of the individual and the group. 

In any case, the adolescent of today is affected by conflicting tech¬ 
niques which show a transition from one cultural practice to the 
other. In general, religious and governmental controls still follow the 
earlier pattern. Within the family, members of different ages fre¬ 
quently differ in their controlling techniques. The family as a whole 
may differ substantially from other groups of which the individual is 
a member. We cannot say that a single set of practices with respect 
to the control of sexual behavior is characteristic of the culture of 

such a person. 


THE EFFECT OF CULTURE 
UPON BEHAVIOR 

It is often said that “human nature is the same the world over.” 
This may mean that behavioral processes are the same whercr er they 
are eneountcred-that all behavior saries in the same svay with 
changes in deprivation or reinforcement, that discrinrmat.ons are 
fomied in the same svay, that extinction takes place at the same rate 
and so on. Such a contention may be as correct as the statement that 
human respiration, digestion, and reproduction are 
world over. Undoubtedly there are personal differences in . 

which various changes take place in all these areas, but the basic 
processes mav have relatis ely constant properties. 1 he statement may 
Iho mean that the independent variables which determine bdravmr 
are the same the world over, and this is another matter. Genetic 
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endowments differ widely, and environments are likely to show 
more differences than similarities, a large number of which may be 
traced to cultural variables. The result is, of course, a high degree of 
indi\iduality. 

I’lic effect of a social environment upon the behavior of the indi¬ 
vidual may be inferred point for point from an analysis of that 
cuvironnicnt. Let us consider an individual at the age of thirty. To 
what extent may his behavior reasonably be traced to the cultural 
variables with which he has come into contact? 

Work level. In the sense that particular parts of our subject’s 
repertoire show given probabilities as the result of reinforcement, we 
say that he shows a given level of interest, enthusiasm, or freedom 
from “mental fatigue.” We are likely to find a high level of relevant 
behavior if the physical environment includes a favorable climate, an 
adequate food supply, and other resources. It is also important that 
abundant positive reinforcement is supplied by the family, the group 
as a whole, and various subgroups, as well as by governmental, re¬ 
ligious. psychotherapeutic, economic, and educational agencies. 

Motivation. Whether an individual is frequently hungr)' will de¬ 
pend, not only upon the availabilit)' of food in the nonsocial environ¬ 
ment, but upon cultural practices which control what he eats, when 
he eats it, whether he observes periods of fasting, and so on. His 
sexual behavior will depend, not only upon the availability of mem¬ 
bers of the opposite sex, but upon the ethical control of sexual rela¬ 
tions, upon governmental and religious restrictions, upon sex educa¬ 
tion, and so on. Other kinds of deprivation and satiation are also 
controlled by both social and nonsocial conditions. 

Emotional dispositions. The social environment is mainly responsi¬ 
ble for the fact that our subject may have grown up in an atmosphere 
of love, hate, anger, or resentment, and that various emotional pat¬ 
terns may therefore characterize his behavior. 

Repertoire. The inanimate world builds an elaborate repertoire of 
practical responses. It may also set up behavior which is effective in 
extending such a repertoire: our subject will show a strong ^‘curiosity 
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about nature” if exploratorj' responses have frequently been rein¬ 
forced and special skills in research and invention if sclf-manipulativc 
behavior of the sort discussed in Chapter XVI has been conditioned. 
But the comparable repertoire generated by the culture is «sua v 
much more extensive. Verbal problem-solving and the social skills 
employed in personal control arc important examples. All controlling 
agencies are concerned in part with tlie creation of bchav.or of this 
sort, although it is the special concern, of course, of education. T le 
competence of the individual in dealing with things, as well as men, 
will depend largely upon the extent to which such agencies have 

characterized the social environment. 


Selfxontrol. The inanimate environment may establish some degree 
of self-control-for example, the individual may leam not to eat a 
delicious but indigestible food-but by far the greater part of selh 
control is culturally determined, particularly by ethical, religious, and 
governmental agencies. The amoral individual who escapes this mflu 
Lee shows the effect of too little control, while the complete y in¬ 
hibited” or restrained individual stands at the other extreme^ Whether 
our subject conspicuously displays the other effects of his cuUure 
which we have just considered will often depend upon this one effect. 
For example he may behave readily in an emotional fashion or show 
a stoical rLtraint depending upon the extent to which his emotional 
betavTor hlfbeen rLforced or punished as right or wrong, legal or 

illegal, or pious or sinful. 

Self-knowledge. Discriminative responses to one’s own behavior 
and to the varfables of which it is a function appear to be the ex- 
1 ■ rodiirt of the social environment. Whether or not our sub- 

c P conscious and introspective depends upon the extent 
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emotional reactions will depend mainly upon the controlling prac¬ 
tices of the group into which he was born. 

CULTURAL CHARACTER 

When certain features of the social environment are peculiar to a 
gi\'en group, we expect to find certain common characteristics in the 
behavior of its members. A common culture should lead to a com¬ 
mon “character.” Russian and American children learn to throw 
stones and to keep from stubbing their toes in essentially the same 
wa}' because the relevant variables are principally in the physical envi¬ 
ronment. They do not speak in the same way because their verbal en¬ 
vironments are different. Other kinds of behavior which are socially 
reinforced are also different. The two groups follow different classifi¬ 
cations in shaping the behavior of the individual as right or wrong. 
Religious, governmental, psychotherapeutic, economic, and educa¬ 
tional agencies differ widely in the power and extent of their control. 
The effects of the family and of business and social organizations are 
also different. As a result Russians and Americans show very different 
behavioral repertoires or “characters.” 

The concept of a group or cultural character, however, has all the 
dangers inherent in any system of ty^pology. There is always a ten¬ 
dency to argue that, because individuals are similar in one respect, 
they are similar in others also. Although certain features of behavior 
may differ consistently between cultures, there are also great differ¬ 
ences among the individuals in a given group. We have seen that a 
social environment is never wholly consistent. It is also probably 
never the same for two individuals. Only those characteristics of the 
social environment which are common to the inhabitants of Russia 
and which differ from the characteristics of any other social environ¬ 
ment may be spoken of as “Russian culture.” The Russian language 
fulfills these conditions fairly well, and it should be possible to detect 
certain corresponding features of “Russian thought” as part of the 
Russian “character.” It is not easy to find other instances, especially 
of manners and customs, which satisfy' these conditions so well. 

It is difficult to demonstrate a relation between a given cultural 
practice and a characteristic of behavior on the empirical evidence 



CULllIRF. AND CON'IROI. 


42 > 


obtained by studying a particular group. Recently certain aspects of 
national character have been attributed to practices in the care of 
infants. In some national or cultural groups a baby is held essentially 
immobile throughout the greater part of the first year through the 
use of swaddling clothes or a cradle board, it has been argued that, 
especially in the last three months of the year, this physical restraint 
is highly frustrating and leads to powerful emotional predispositions. 

If the baby submits to restraint, the effect may be evident in the be¬ 
havior of the adult, who becomes a “follower.” If the restraint 
strengthens a tvpical pattern of rage or revolt, the effect may be 
obscA'cd when he becomes a “leader. A particular practice in caring 
for infants is thus said to produce two types of adult character. 'I’he 
types fit nicely into an inteqjretation of a particular political pattern, 
but the evidence is not satisfactory. The extent to which such a cul¬ 
tural practice as swaddling characterizes a group, and is absent from 
other groups with which a comparison is being made, can presumabU 
be determined by field obsen-ation or other forms of inqui^)^ Whether 
the adult members of any group fall into hvo classes showing, 
respectively, submissive and aggressive behavior can also presumably 
be established, although this has not been done. Even if we were to 
accept these facts as proved, a relation between them would not 
therefore be established. By the very nature of the cultural group as 
a sample, many other practices will be associated with any one prac¬ 
tice chosen for study. Some other practice may therefore be responsi¬ 
ble for any demonstrated aspect of group character. 

The anthropologist is interested in groups of people as such, and 
he pays particular attention to the customs, manners, and other fea¬ 
tures of behavior peculiar to a given group. So long as we are not 
interested in any particular set of cultural practices, the issue of a 
national or cultural character will not have the same urgency. We 
may agree that if a group is characterized by a umqiie set of P^^-^^ices 
it may also be characterized by unique modes of behavior, but the 
causal connection between the practice and the mode of behavior 
may be left to a functional analysis of relevant variables under the 

conditions characteristic of an experimental science. 
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DESIGNING A CULTURE 


The social environment of any group of people is the prod¬ 
uct of a complex series of events in which accident sometimes plays 
a prominent role. Manners and customs often spring from circum¬ 
stances which have little or no relation to the ultimate effect upon 
the group. The origins of more explicit controlling practices may be 
equally adventitious. Thus the pattern of control exercised by a strong 
leader, reflecting many of his personal idiosyncrasies, may result in an 
established governmental classification of behavior as legal or illegal 
and may even set the pattern for a highly organized agency. The 
techniques which a saint employs to control himself may become 
part of the established practices of a religious agency. Economic 
control is determined in part by the resources available to the group, 
which are ultimately a matter of geography. Other fortuitous factors 
are introduced when different cultures intermingle or when a culture 
survives important changes in the nonsocial environment. A cultural 
practice is not the less effective in determining the behavior character¬ 
istic of a group because its origins are accidental. But once the effect 
upon behavior has been observed, the source of the practice may be 
scrutinized more closely. Certain questions come to be asked, ^^y 
should the design of a culture be left so largely to accident? Is it not 
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possible to change the social environment deliberately so that the 
human product will meet more acceptable specifications? 

In many cultural groups we observe practices which might be 
described as ‘'making changes in practice.” I’hc great religious books 
supply many examples of the deliberate construction of a social 
environment. The Ten Commandments were a codification of exist¬ 
ing and proposed practices according to which, henceforth, behavior 
was to be reinforced or punished by the group or by the religious 
agency. The teachings of Christ were more clearly in the nature of a 
new design. In governmental control, the enactment of a law usually 
establishes new cultural practices, and a constitution is a similar 
undertaking on a broader scale. Experimental curricula in schools and 
colleges and books on child care which recommend substantial 
changes in family practices arc attempts to manipulate important 
parts of a culture. Tlie social environment is changed to some extent 
when a new technique of psychotherapy is derived from a thcon*' or 
from an experimental study of human behavior. Social legislation 
creates an experimental environment in which behavior is more often 
reinforced with food, clothing, housing, and so on, and in which cer¬ 
tain kinds of deprivation are less likely to occur. Planning the struc¬ 
ture of a large industrv' or governmental agency is an experiment in 
cultural design, Tliese are all examples of the manipulation of small 
parts of the social environment; what is called "Utopian” thinking 
embraces the design of a culture as a whole. 

The deliberate manipulation of the culture is therefore itself a 
characteristic of many cultures—a fact to be accounted for in a 
scientific analysis of human behavior. Proposing a change in a cul¬ 
tural practice, making such a change, and accepting such a change 
are all parts of our subject matter. Although this is one of the most 
complex of human activities, the basic pattern seems clear. Once a 
given feature of an environment has been shown to have an effect 
upon human behavior which is reinforcing, either in itself or as an 
escape from a more aversive condition, constructing such an environ¬ 
ment is as easily explained as building a fire or closing a window when 
a room grows cold. A doctor tells his patient to stop eating a certain 
food so that he will no longer be troubled by an allergj' because he 



428 THE CONTROL OF HUMAN BEHAVIOR 

has observed a connection between the food and the allergy. The 
psychotherapist tells his patient to change to a job to which he is 
better suited so that he will suffer less from a sense of failure because 
a similar connection has been established. An economist advises a 
government to impose heavy taxes in order to check inflation because 
still another relation has been observed. All these examples involve 
many detailed steps, many of them verbal, and we should need a 
more detailed analysis of scientific thinking than can be undertaken 
here to give a reasonable account of particular instances. But the 
basic process is clear enough to permit some interpretation. 

When we speak of the “deliberate" design of a culture, we mean 
the introduction of a cultural practice “for the sake of its conse¬ 
quences.” But as we saw in discussing “voluntary behavior" in 
Chapter VII, it is never a future consequence which is effective. A 
change in practice is made because similar changes have had certain 
consequences in the past. When the individual describes his own 
behavior, he may speak of past consequences as the “goal" of his 
current action, but this is not very helpful. We can best understand 
the cultural designer, not by guessing at his goals or asking him to 
guess at them for us, but by studying the earlier environmental 
events winch Iiavc led him to advocate a cultural change. If he is 
basing a given proposal upon scientific experiments, we want to know 
how closely the experimental and practical situations correspond. We 
may also want to examine other “reasons for making a change” which 
arc to be found in his personal history’ and in the recorded history 
of those who have investigated similar areas. 

\^\LUK JUDGMENTS 

Such an interpretation of the behavior of the cultural designer 
brings us to an issue of classical proportions. Eventually, a science of 
human behavior may be able to tell the designer what kind of culture 
must be set up in order to produce a given result, but can it ever tell 
him what kind of result he should produce? The word “should” 
brings us into the familiar realm of the value judgment. It is com¬ 
monly argued that there are two kinds of knowledge, one of fact and 
the other of value, and that science is necessarily confined to the 



DESIGNING A CULTURE 429 


first. Does the design of a culture demand the second? Must the 
cultural designer eventually abandon science and turn to other ways 
of thinking? 

It is not true that statements containing “should” or “ought” have 
no place in scientific discourse. There is at least one use for which 
an acceptable translation can be made. A sentence beginning “You 
ought” is often a prediction of reinforcing consequences. “You ought 
to take an umbrella” may be taken to mean, “You will be reinforced 
for taking an umbrella.” A more explicit translation would contain 
at least three statements: (1) Keeping dry' is reinforcing to you; (2) 
carr)'ing an umbrella keeps you dry in the rain; and (3) it is going 
to rain. All these statements are properly within the realm of science. 
In addition to this, of course, the word “ought” plays a large part 
in the control exercised by the ethical group and by governmental and 
religious agencies. The statement, “You ought to take an umbrella,” 
may be emitted, not as a prediction of contingencies, but to induce 
an individual to take an umbrella. The “ought” is aversive, and the 
individual addressed may feel guilty if he does not then take an um¬ 
brella. This exhortator)' use may be accounted for in the usual way. 
It is nothing more than a concealed command and has no more con¬ 
nection with a \’alue judgment than with a scientific statement of fact. 

The same interpretation is possible when the reinforcing conse¬ 
quences are of an ethical nature. “You ought to love your neighbor” 
may be converted into the two statements: (1) “The approval of 
your fellow men is positively reinforcing to you” and (2) “loving 
)Our fellow men is approved by the group of which you are a mem¬ 
ber,” both of which may be demonstrated scientifically. The state¬ 
ment may also be used, of course, to coerce an individual into behav¬ 
ing in a fashion which resembles loving his neighbor, and indeed is 
probably most often used for this reason, but again this is not what 

is meant by a value judgment. 

When a given change in cultural design is proposed primarily to 
induce people to make the change, we may account for it as in the 
exhortatory example above. The proposal may also be a prediction of 
consequences. Sometimes these are easily specified, as when it is said 
that the group “ought” to approve of honesty because its members 
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will thus avoid being deceived or that it “ought” to disapprove of 
theft because its members will then avoid the loss of property. Some¬ 
times the implied consequences are less obvious, as when a study of 
behavior leads someone to propose that we “ought” to deal with 
criminals in a certain way or that we “ought” to avoid aversive con¬ 
trol in education. It is at this point that the classical values of free¬ 
dom, security, happiness, knowledge, and so on are usually appealed 
to. We have seen that these often refer indirectly to certain imme¬ 
diate consequences of cultural practices. But the crucial issue concern¬ 
ing value hinges upon another meaning of the word “ought” in 
which a more remote consequence is implied. Is there a scientific 
parallel for this kind of value? 


THE SURVIVAL OF A CULTURE 

We have seen that in certain respects operant reinforcement re¬ 
sembles the natural selection of evolutionary theory. Just as genetic 
characteristics which arise as mutations are selected or discarded by 
their consequences, so novel forms of behavior are selected or dis¬ 
carded through reinforcement. There is still a third kind of selection 
which applies to cultural practices. A group adopts a given practice— 
a custom, a manner, a controlling device—either by design or through 
some event which, so far as its effect upon the group is concerned, 
may be wholly accidental. As a characteristic of the social environ¬ 
ment this practice modifies the behavior of members of the group. 
Tlie resulting behavior may affect the success of the group in com¬ 
petition with other groups or with the nonsocial environment. Cul¬ 
tural practices which are advantageous will tend to be characteristic 
of the groups which survive and which therefore perpetuate those 
practices. Some cultural practices may therefore be said to have sur¬ 
vival value, while others are lethal in the genetic sense. 

A given culture is, in short, an experiment in behavior. It is a par¬ 
ticular set of conditions under which a large number of people grow 
and live. These conditions generate the patterns or aspects of be¬ 
havior—the cultural character—which we have already examined. 
The general interest level of members of the group, their motivations 
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and emotional dispositions, their behavioral repertoires, and the 
extent to which they practice self-control and self-knowledge are all 
relevant to the strength of the group as a whole. In addition the 
culture has an indirect effect upon other factors. The general health 
of the group will depend upon birth rate, hygiene, methods of child 
care, general living conditions, and hours and kinds of work, upon 
whether many men and women of talent go into medicine and 
nursing, and upon what proportion of the wealth of the group goes 
into the construction of hospitals, public health ser\’iccs, and so on. 
All these conditions, in turn, depend upon the culture. Cultural 
practices are also largely responsible for the use which is made of the 
genetic material born into the group, since they determine whether 
the individual will be able to develop his talents fully, whether edu¬ 
cational institutions will be open to him regardless of class or other 
distinction, whether educational policies are progressive or reaction- 
ar)% whether he will be subject to political or economic favoritism in 
the selection of a profession, and so on. The culture also determines 
the extent to which the members of the group are preoccupied with 
food or sex or with escape from minor aversive stimulation in the 
search for “comfort” or from such major aversive stimulation as hard 
labor or combat, as well as the extent to which they are subject to 
exploitation by powerful agencies. In turn, therefore, it determines 
the extent to which they are able to engage in productive activities 
in science, art, crafts, sports, and so on. The experimental test of a 
given culture is provided by competition between groups under the 
conditions characteristic of a particular epoch. 

Is survival, then, a criterion according to which a given cultural 
practice may be evaluated? Those who are accustomed to appealing 
to more traditional values are usually not willing to accept this 
alternative. Survival value is a difficult criterion because it has perhaps 
even less obvious dimensions than happiness, freedom, knowledge, 
and health. It is not an unchanging criterion, for what may in this 
sense be a “good” culture in one period is not necessarily “good” in 
another. Since survival always presupposes competition, if only with 
the inanimate environment, it does not appear to define a “good” 
culture in the absence of competition. There appears to be no way 
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in which we can test the survival value of a culture in vacuo to 
determine its absolute goodness. Conversely, the temporary survival 
of a culture is no proof of its goodness. All present cultures have 
obviously survived, many of them without very great change for 
hundreds of years, but this may not mean that they are better cultures 
than others which have perished or suffered drastic modification 
under more competitive circumstances. The pnnciple of survival does 
not permit us to argue that the status quo must be good because it 

is here now. 

Another difficulty is that survival is often in direct conflict with 
traditional values. There are circumstances under which a group is 
more likely to survive if it is not happy, or under which it will survive 
only if large numbers of its members submit to slavery. Under certain 
circumstances the survival of a culture may depend upon the un¬ 
restricted exercise of sexual behavior, while under other circumstances 
severely repressive control may strengthen advantageous behavior of 
other sorts. In order to accept survival as a criterion in judging a 
culture, it thus appears to be necessary to abandon such principles 
as happiness, freedom, and virtue. Perhaps the commonest objection 
to survival is essentially an aversive reaction to the practices which 
have, thus far in the history of mankind, had survival value. Aggres¬ 
sive action has usually been most successful in promoting the survival 
of one group against another or of one individual against another. 

These difficulties appear to explain why those who are accustomed 
to the traditional values hesitate to accept survival as an alternative. 
We have no reason to urge them to do so. We need not say that any¬ 
one chooses survival as a criterion according to which a cultural 
practice is to be evaluated. Human behavior does not depend upon 
the prior choice of any value. When a man jumps out of the way of 
an approaching car, we may say that he “chooses life rather than 
death.” But he does not jump because he has so chosen; he jumps 
because jumping is evoked by certain stimulating circumstances. This 
fact is explained in turn by many earlier contingencies of reinforce¬ 
ment in which quick movement has reduced the threat of impending 
aversive stimulation or has, in the sense of Chapter XI, avoided aver¬ 
sive consequences. Now, the fact that the individual responds or can 
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be conditioned to respond in this way is not wholly unrelated to the 
issue of life or death. It is obvious, after the fact, that the behavior 
has worked to his advantage. But this particular advantage could not 
have operated before he jumped. Only past advantages could have 
had an effect upon his behavior. He was likely to jump or to learn to 
jump because his ancestors were selected from a large population just 
because they jumped or learned to jump quickly from the paths of 
moving objects. Those who did not jump or could not learn to jump 
are probably not represented by contemporary descendants. The 
“value” which the individual appears to have chosen with respect 
to his own future is therefore nothing more than that condition 
which operated selectively in creating and perpetuating the behavior 
which now seems to e.xemplify such a choice. An individual does not 
choose to live or die; he behaves in ways which work toward his 
surs'ival or death. Behavior usually leads to survival because the be¬ 
having individual has been selected by simhval in the process of 
evolution. 

In the same sense, the behavior of making a constructive suggestion 
about a cultural practice does not involve the “choice of a value.” 
A long biological and cultural history has produced an individual who 
acts in a particular way with respect to cultural conditions. Our prob¬ 
lem is not to determine the value or goals which operate in the 
behavior of the cultural designer; it is rather to examine the complex 
conditions under which design occurs. Some changes in culture may 
be made because of consequences which are roughly described as 
happiness, freedom, knowledge, and so on. Eventually, the survival 
of the group acquires a similar function. The fact that a given practice 
is related to survival becomes effective as a prior condition in cultural 
design. Survival arrives late among the so-called values because the 
effect of a culture upon human behavior, and in turn upon the 
perpetuation of the culture itself, can be demonstrated only when 
a science of human behavior has been well developed. The “practice 
of changing practice” is accelerated by science just because science 
provides an abundance of instances in which the consequences of 
practices are shown. The individual who is familiar with the results of 
science is most likely to set up comparable conditions in cultural 
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design, and we may say, if the expression will not be misunderstood, 
that he is using sur\’ival as a criterion in evaluating a practice. 

CAN WE ESTIMATE SURVIVAL VALUE? 

The evolution of cultures appears to follow the pattern of the 
evolution of species. The many different forms of culture which arise 
correspond to the "mutations" of genetic theory. Some forms prove 
to be effective under prevailing circumstances and others not, and 
the perpetuation of the culture is determined accordingly. When we 
engage in the deliberate design of a culture, we are, so to speak, 
generating "mutations" which may speed up the evolutionary process. 
The effect could be random, but there is also the possibility that such 
mutations may be especially adapted to survival. 

But there is one difficulty and it is a very serious one. Survival will 
not have a useful effect upon the behavior of the cultural designer 
unless he can actually calculate survival value. A number of current 
issues suggest that this is not always possible. We may change the 
pattern of family life and of educational institutions so that children 
will grow up to be happier people, but are we sure that happy people 
arc most likely to sur\'ive in the world today? The psychotherapist 
faces a comparable problem which is best exemplified by the writings 
of Freud himself. Freud was, on the one hand, interested in curing 
neuroses and, on the other, in demonstrating the importance of the 
achievements of neurotic men. Would a group of nonneurotic people 
lack scientific and artistic initiative, and if so, could they compete with 
a group of moderately neurotic people? Similarly, in governmental 
design, it may be possible to give everyone a considerable measure of 
security, but will the government which does so then be supported 
by an energetic, productive, and inventive people? 

Practical situations are almost always more complex than those of 
the laboratory since they contain many more variables and often 
many unknowns. This is the special problem of technology as against 
pure science. In the field of human behavior, particularly in the de¬ 
sign of culture, we must recognize a kind of complexity in the face 
of which the rigor of a laboratory science cannot be maintained. But 
this does not mean that science cannot contribute to the solution of 
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crucial problems. It is in the spirit of science to insist upon careful 
observation, the collection of adequate information, and the formula¬ 
tion of conclusions which contain a minimum of wishful thinking. 
All of this is as applicable to complex situations as to simple. In addi¬ 
tion, a rigorous science of human behavior offers the following kinds 
of practical help. 

A demonstration of basic behavioral processes under simplified 
conditions enables us to see these processes at work in complex cases, 
even though they cannot be treated rigorously there. If these proc¬ 
esses are recognized, the complex case may be more intelligently 
handled. This is the kind of contribution which a pure science is 
most likely to make to technology. For example, a behavioral process 
frequently occupies a considerable period of time and often cannot 
be obser\'ed at all through casual observation. When the process is 
revealed with proper recording techniques under controlled condi¬ 
tions, we may recognize it and utilize it in the complex case in the 
world at large. Punishment gives quick results, and casual observation 
recommends its use, but we may be dissuaded from taking this 
momentary advantage if we know that progress towards a better solu¬ 
tion is being made in some alternative course of action. It is difficult 
to resist punishing a child for conduct which it will eventually out¬ 
grow without punishment until we have adequate evidence of the 
process of growth. Only when developmental schedules have been 
carefully established by scientific investigation are we likely to put 
up with the inconvenience of foregoing punishment. The process of 
extinction also requires a good deal of time and is not clear to casual 
inspection. We are not likely to use the process effectively until the 
scientific study of simpler instances has assured us that a given end- 
state will indeed be reached. It is the business of science to make 
clear the consequences of various operations performed upon a sys¬ 
tem. Only when we have seen these consequences clearly set forth 
are we likely to be influenced by their counterparts in complex prac¬ 
tical situations. 

A rigorous science of behavior makes a different sort of remote 
consequence effective when it leads us to recognize survival as a 
criterion in evaluating a controlling practice. W^e have seen that hap- 
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pincss, justice, knowledge, and so on are not far removed from certain 
immediate consequences which reinforce the individual in selecting 
one culture or one practice against another. But just as the immediate 
advantage gained through punishment is eventually matched by later 
disadvantages, these immediate consequences of a cultural practice 
may be followed by others of a different sort. A scientiSc analysis may 
lead us to resist the more immediate blandishments of freedom, 
justice, knowledge, or happiness in considering the long-run conse¬ 
quence of survival. 

Perliaps the greatest contribution which a science of behavior may 
make to the evaluation of cultural practices is an insistence upon 
experimentation. We have no reason to suppose that any cultural 
practice is always right or wrong according to some principle or value 
regardless of the circumstances or that anyone can at any given time 
make an absolute evaluation of its survival value. So long as this is 
recognized, we are less likely to seize upon the hard and fast answer 
as an escape from indecision, and we are more likely to continue to 
modify cultural design in order to test the consequences. 

Science helps us in deciding between alternative courses of action 
by making past consequences effective in determining future conduct. 
Although no one course of action may be exclusively dictated by 
scientific experience, the existence of any scientific parallel, no matter 
how sketchy, will make it somewhat more likely that the more profit¬ 
able of two courses will be taken. To those who are accustomed to 
evaluating a culture in terms of absolute principles, this may seem 
inadequate. But it appears to be the best we can do. The formalized 
experience of science, added to the practical experience of the indi¬ 
vidual in a complex set of circumstances, offers the best basis for 
effective action. What is left is not the realm of the value judgment; 
it is the realm of guessing. When we do not know, we guess. Science 
docs not eliminate guessing, but by narrowing the field of alternative 
courses of action it helps us to guess more effectively. 



XXIX 


THE PROBLEM OF CONTROL 


There are certain rules of thumb according to which human 
behavior has long been controlled which make up a species of pre* 
scientific craft. The scientific study of behavior has reached the point 
where it is supplying additional techniques. As the methods of science 
continue to be applied to behavior, we may expect technical contribu¬ 
tions to multiply rapidly. If we may judge from the application of 
science to other practical problems, the effect upon human affairs 
will be tremendous. 

We have no guarantee that the power thus generated will be used 
for what now appear to be the best interests of mankind. As the 
technology of modern warfare clearly shows, scientists have not 
been able to prevent the use of their achievements in ways which are 
very far from the original purposes of science. A science of behavior 
does not contain within itself any means of controlling the use to 
which its contributions will be put. Machiavellfs prescientific insight 
into human behavior was dedicated to preserving the power of a gov¬ 
ernmental agency. In Nazi Germany the results of a more exact 
science were applied to similarly restricted interests. Can this be pre¬ 
vented? Are we to continue to develop a science of behavior without 
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regard to the use which will be made of it? If not, to whom is the 

control which it generates to be delegated? 

This is not only a puzzling question, it is a frightening one; for 

there is good reason to fear those who are most apt to seize contro . 
To the suggestion that science would eventually be able to contro 
man’s thoughts with precision" Winston Churchill once replied I 
shall be very content if my task in this world is done before that 
happens.” This is not, however, a wholly satisfactory disposition of 
the problem. Other kinds of solutions may be classihed under four 

general headings. 

Denying control. One proposed solution is to insist that man is 
a free agent and forever beyond the reach of controlling techniques. 
It is apparently no longer possible to seek refuge in that belief. The 
freedom which is at issue in the evaluation of governments is related 
to the countcrcontrol of aversive techniques. A doctrine of personal 
freedom appeals to anvone to whom the release from coercive control 
is important. But behavior is determined in noncoercive ways; and 
as other kinds of control are better understood, the doctrine of per¬ 
sonal freedom becomes less and less effective as a motivating device 
and less and less tenable in a theoretical understanding of human 
behavior. We all control, and we are all controlled. As human be¬ 
havior is further analyzed, control will become more effective. Sooner 
or later the problem must be faced. 

Refusing to control. An alternative solution is the deliberate rejec¬ 
tion of the opportunity to control. The best example of this comes 
from psychotherapy. The therapist is often clearly aware of his power 
over the individual who turns to him for help. The misuse of that 
power requires, as we have seen, unusual ethical standards. Carl R. 
Rogers has written, “One cannot take responsibility for evaluating a 
person’s abilities, motives, conflicts, needs; for evaluating the adjust¬ 
ment he is capable of achieving, the degree of reorganization he 
should undergo, the conflicts which he should resolve, the degree of 
dependence which he should develop upon the therapist, and the 
goals of therapy, without a significant degree of control over the 
individual being an inevitable accompaniment. As this process is 
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extended to more and more persons, as it is for example to thousands 
of veterans, it means a subtle control of persons and their values and 
goals by a group wliich has selected itself to do tlic controlling. I he 
fact that it is a subtle and well-intentioned control makes it only 
less likely that people will realize what they are accepting." * Rogers' 
solution is to minimize the contact between patient and therapist to 


the point at which control seems to vanish. 

Philosophies of government which arise from a similar fear of con 
trol are represented in an extreme form by anarchy and more con¬ 
servatively by the doctrine of laisser faire. "He governs best who 
governs least.” This does not mean that moderate govcrnmcnbal 
techniques are especially effective, for if that were true the moderate 
gos'crnment would govern most. It means that a government which 
governs least is relatively free from the dangers of misuse of power. 
In economics a similar philosophy defends the normal stabilizing 
processes of a “free” economy against all forms of regulation. 

To refuse to accept control, how-cver, is merely to leave control in 
other hands. Rogers has argued that the individual holds within him¬ 
self the solution to his problems and that for this reason the therapist 
need not take positive action. But what are the ultimate sources of 
the inner solution? If the individual is the product of a culture in 
which there is marked ethical and religious training, in which govern¬ 
mental control and education have been effective, in which economic 
reinforcement has worked in an acceptable way, and in which there 
is a substantial lay wisdom applicable to personal problems, he may 
very well “find a solution,” and a therapist may not be necessary. But 
if the individual is the product of excessive, unskillful, or otherwise 
damaging control, or has received atypical ethical or religious train¬ 
ing, or is subject to extreme deprivations, or has received pow'erful eco¬ 
nomic reinforcements for asocial behavior, no acceptable solution may 
be available “within himself.” In government a philosophy of laisser 
faire is effective if the citizen is in contact with religious, educational, 
and other types of agencies, which supply the control which the gov¬ 
ernment refuses to accept. The program of anarchy, which argues 
that man will flourish as soon as governmental control is withdrawn, 

1 Harvard Educational Review, Fall 1948, page 212. 
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usually neglects to identify the other controlling forces which adapt 
man to a stable social system. A “free society” is one in which the 
individual is controlled by agencies other than government. The faith 
in the common man” which makes a philosophy of democracy pos¬ 
sible is actually a faith in other sources of control. When the govern¬ 
mental structure of the United States was being designed, the advo¬ 
cates of a minimal government could point to effective religious and 
ethical controls; if these had been lacking, a program of laisser faire 
would have left the people of the country to other controlling agencies 
with possibly disastrous results. Similarly, in an uncontrolled econ¬ 
omy, prices, wages, and so on are free to change as functions of 
variables which are not arranged by a governmental agency; but they 
are not free in any other sense. 

To refuse to accept control, and thus to leave control to other 
sources, often has the effect of diversifying control. Diversification is 
another possible solution to our problem. 

Diversifying control. A rather obvious solution is to distribute the 
control of human behavior among many agencies which have so little 
in common that they are not likely to join together in a despotic 
unit. In general this is the argument for democracy against totalitari¬ 
anism. In a totalitarian state all agencies are brought together under 
a single superagency. A state religion conforms to governmental prin¬ 
ciples. Through state ownership the superagency acquires complete 
economic control. Schools are used to support governmental practices 
and to train men and women according to the needs of the state, 
while education which might oppose the governmental program is 
prevented through control of speech and the press. Even psycho¬ 
therapy may become a function of the state, as in Nazi Germany, 
where, because there were no opposing agencies, extreme measures 
were adopted. 

A unified agency is often said to be more efficient, but it makes a 
solution to the problem of control very difficult. It is the inefficiency 
of diversified agencies which offers some guarantee against the 
despotic use of power. A simple example of the beneficial effect of 
diversification is provided by American advertising. Large sums of 
money are spent annually to induce people to purchase particular 
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brands of goods. A large part of the control attempted by each com¬ 
pany is counteracted by the control attempted by others. Insofar as 
advertising is directed toward the choice of brand only, the net effect 
is probably slight. If all the money used to promote particular brands 
of cigarettes, for example, were devoted to increasing the number of 
cigarettes smoked per day regardless of brand, the effect miglit well 
be more marked. This fact is recognized by industries which pool 
their advertising funds to promote a type of product rather than 
individual brands. 

In a democracy there is a similar, but much more important, can¬ 
celing out of the effects of control: economic control is often opposed 
by education and by governmental restrictions; governmental and 
religious control is often opposed by psychotherapy; there is often 
some opposition between government and religion; and so on. So 
long as the opposing forces remain in some sort of balance, excessive 
exploitation by any one agency is avoided. This does not mean that 
control is never misused. Proceeds from control tend to be less con¬ 
spicuous when thus divided, and no one agency increases its power 
to the point at which the members of the group take alarm. It does 
not follow, however, that diversified control does more than diversify 

the proceeds. 

The great advantage of diversification is not closely related to the 
problem of control. Diversification permits a safer and more flexible 
experimentation in the design of culture. The totalitarian state is 
weak because if it makes a mistake, the whole culture may be de¬ 
stroyed. Under diversification, new techniques of control may be 
tested locally without a serious threat to the whole structure. 

Those who accept diversification as a solution to the problem of 
control find it possible to adopt several appropriate measures. One 
controlling agency is explicitly opposed to another. Legislation against 
monopolistic practices, for example, prevents the development of the 
unlimited economic power of a single agency. It often has the effect 
of setting up two or three powerful agencies among which a given 
sort of economic control is distributed. In education an explicit 
diversification is implied in any opposition to standardized practices. 
By maintaining many different kinds of educational institutions. 
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working in different ways and achieving different results, we gain the 
advantages of safe experimentation and avoid excessive emphasis on 
any one program. In America diversification in government is ex¬ 
emplified by the coexistence of federal, state, and local governments, 
while religious control is distributed among many sects. 

To those who fear the misuse of a science of human behavior this 
solution dictates an obvious step. By distributing scientific knowledge 
as widely as possible, we gain some assurance that it will not be 
impounded by any one agency for its own aggrandizement. 

Controlling control. In another attempt to solve the problem of 
control a governmental agency is given the power to limit the extent 
to which control is exercised by individuals or by other agencies. The 
possibility of controlling men through force, for example, is all too 
evident. One strong man governing through force alone is a small 
totalitarian state. When the force is distributed among many men, 
the advantages of diversification ensue: there is some cancellation of 
effect, exploitation is less conspicuous, and the strength of the group 
does not depend so critically upon the continuing strength of one 
man. But an advance over the mere diversification of force is achieved 
by a government which functions to “keep the peace”—to prevent 
any sort of control through the use of force. Such a government may 
be extended to other forms of control. In modem democracies, for 
example, the man in possession of great wealth is not permitted to 
control behavior in all the ways which would otherwise be open to 
him. The educator is not permitted to use the controls at his disposal 
to establish certain kinds of behavior. Religion and psychotherapy 
are not permitted to encourage or condone illegal behavior. Personal 
control is restricted by giving the individual redress against “undue 
influence.” 

In this solution to the problem there is no doubt where the ulti¬ 
mate control rests. But if such a government is to operate efficiently, 
it must be assigned superior power, and the problem of preventing its 
misuse remains. The problem has apparently been solved with respect 
to control through force whenever a government has successfully kept 
the peace without otherwise interfering in the lives of its citizens. 
But this result is not inevitable. Governments which are assigned 
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force in order to keep the peace may use it to control citizens in other 
ways and to fight other governments. Other sorts of control may also 
be misused. A government which is able to restrict the control exer¬ 
cised by a particular agency may coerce that agency into supporting 
its own program of expansion. The totalitarian state begins perhaps 
by merely restricting the control of the agencies under it, but it can 
eventually usurp their functions. 1 his has happened in the past. Does 
a science of behavior necessarily make it less likely to happen again? 

A POSSIBLE SAFEGUARD 
AGAINST DESPOTISM 

The ultimate strength of a controller depends upon the strength 
of those whom he controls. The wealth of a rich man depends upon 
the productivity of those whom he controls through wealth; slaver) 
as a technique in the control of labor eventually proves nonproduc¬ 
tive and too costly to surs-ive. The strength of a government depends 
upon the inventiveness and productivity of its citizens; coercive con¬ 
trols which lead to inefficient or neurotic behavior defeat their own 
purpose. An agency which employs the stupefying practices of propa¬ 
ganda suffers from the ignorance and the restricted repertoires of 
those whom it controls. A culture which is content with the status 
quo-which claims to know what controlling practices are best and 
therefore does not experiment-may achieve a temporary stability but 

only at the price of eventual extinetion. 

By showing how governmental practices shape the behavior of 

those governed, science may lead us more rapidly to the design of a 
government, in the broadest possible sense, which will necessarily 
promote the well-being of those who are governed. The maximal 
strength of the manpower born to a group usually requires conditions 
which are described roughly with such terms as freedom, security, 
happiness, and knowledge. In the exceptional case in which it does 
nob the criterion of survival also works in the interests of the gov¬ 
erned as well as those of the government. It may not be purely wish¬ 
ful thinking to predict that this kind of strength will eventually take 
first place in the considerations of those who engage in the design of 
culture. Such an achievement would simply represent a special case 
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of self-control in the sense of Chapter XV. It is easy for a ruler, or the 
designer of a culture, to use any available power to achieve certain 
immediate effects. It is much more difficult to use power to achieve 
certain ultimate consequences. But every scientific advance which 
points up such consequences makes some measure of self-control in 
the design of culture more probable. 

Government for the benefit of the governed is easily classified as an 
ethical or moral issue. This need not mean that governmental design 
is based upon any absolute principles of right and wrong but rather, 
as wc have just seen, that it is under the control of long-term conse¬ 
quences. All the examples of self-control described in Chapter XV 
could also be classified as ethical or moral problems. We deal with 
the ethics of governmental design and control as we deal with the 
ethics of any other sort of human behavior. For obvious reasons we 
call someone bad when he strikes us. Later, and for as obvious rea¬ 
sons, we call him bad when he strikes others. Eventually we object in 
more general terms to the use of physical force. Countermeasures 
become part of the ethical practices of our group, and religious 
agencies support these measures by branding the use of physical 
force immoral or sinful. All these measures which oppose the use of 
physical force are thus explained in terms of the immediate aversive 
consequences. In the design of government, we can, however, eval¬ 
uate the use of physical force by considering the ultimate effect upon 
the group. Why should a particular government not slaughter the 
entire population of a captured city or country? It is part of our cul¬ 
tural heritage to call such behavior wrong and to react, perhaps in a 
violently emotional way, to the suggestion. The fact that the mem¬ 
bers of a group do react in this way could probably be shown to con¬ 
tribute ultimately to the strength of the group. But quite apart from 
such a reaction we may also condemn such a practice because it 
would eventually weaken the government. As we have seen, it would 
lead to much more violent resistance in other wars, to organized 
counterattack by countries afraid of meeting the same fate, and to 
very serious problems in the control of the government’s own citi¬ 
zens. In the same way, although we may object to slavery because 
aversive control of one individual is also aversive to others, because 
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it is “wrong,” or because it is “incompatible with our conception of 
the dignit}' of man,” an alternative consideration in the design of 
culture might be that slavcir- reduces the cfTectiveness of those who 
are enslaved and has serious effects upon other members of the 
group. Similarly, we defend a way of life which we believe to be 
superior to others by listing those characteristics which are immedi¬ 
ately reinforcing to us and which wc call ethically or morally good; 
but in evaluating a particular cultural experiment wc may, instead, 
ask whether that wav of life makes for the most effective develop- 
ment of those who follow it. 

Ethical and moral principles have undoubtedly been valuable in 
the design of cultural practices. Presumably those principles wliich 
are with us today have been most valuable in this respect. However, 
the ultimate survival value of any given set is not thereby guaran¬ 
teed. What science can tell us about the effect of a given practice 
upon behavior, and the effect of that behavior upon the survival of 
the group, may lead more directly to recognition of the ultimate 
strength of government in the broadest sense. Eventually the ques¬ 
tion must be asked with respect to mankind in general. Much has 
been written recently' of the need to return to moral law in delib¬ 
erations concerning human affairs. But the question, “Whose moral 
law?” frequently proves embarrassing. Faced with the problem of 
finding a moral law acceptable to all the peoples of the world, we 
become more acutely aware of the shortcomings of the principles 
proposed by any one group or agency. The possibility of promoting 
such principles, either through education or military conquest, is not 
promising. If a science of behavior can discover those conditions of 
life which make for the ultimate strength of men, it may provide a 
set of “moral values” which, because they are independent of the 
history and culture of any one group, may be generally accepted. 

WHO WILL CONTROL? 

Although science may provide the basis for a more effective cul¬ 
tural design, the question of who is to engage in such design remains 
unanswered “Who should control?” is a spurious question-at least 
until we have specified the consequences with respect to which it 
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may be answered. If we look to the long-term effect upon the group, 
the question becomes, “Who should control if the culture is to sur¬ 
vive?” But this is equivalent to asking, “Who will control in the 
group which does survive?” The answer requires the kind of predic¬ 
tion which cannot be made with any certainty because of the ex¬ 
tremely complex circumstances to be taken into account. In the long 
run, however, the most effective control from the point of view of 
survival will probably be based upon the most reliable estimates of 
the survival value of cultural practices. Since a science of behavior is 
concerned with demonstrating the consequences of cultural practices, 
we have some reason for believing that such a science will be an 
essential mark of the culture or cultures which survive. The current 
culture which, on this score alone, is most likely to survive is, there¬ 
fore, that in which the methods of science are most effectively 
applied to the problems of human behavior. 

This does not mean, however, that scientists are becoming self- 
appointed governors. It does not mean that anyone in possession of 
the methods and results of science can step outside the stream of 
history and take the evolution of government into his own hands. 
Science is not free, either. It cannot interfere with the course of 
events; it is simply part of that course. It would be quite inconsistent 
if wc were to exempt the scientist from the account which science 
gives of human behavior in general. Science can, however, supply a 
description of the kind of process of which it itself is an example. A 
reasonable statement of our present position in the evolution of cul¬ 
ture might take this form: We find ourselves members of a culture in 
which science has flourished and in which the methods of science 
have come to be applied to human behavior. If, as seems to be the 
case, the culture derives strength from this fact, it is a reasonable pre¬ 
diction that a science of behavior will continue to flourish and that 
our culture will make a substantial contribution to the social environ¬ 
ment of the future. 

THE FATE OF THE INDIVIDUAL 

Western thought has emphasized the importance and dignity of 
the individual. Democratic philosophies of government, based upon 
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the “rights of man,” have asserted that all individuals arc equal under 
the law, and that the welfare of the individual is the goal of govern¬ 
ment. In similar philosophies of religion, piety and salvation have 
been left to the individual himself rather than to a religious ageney. 
Democratic literature and art have emphasized the individual rather 
than the type, and have often been concenied with increasing man’s 
knowledge and understanding of himself. Many schools of psycho¬ 
therapy have accepted the philosophy that man is the master of his 
own fate. In education, social planning, and many other helds, the 
welfare and dignity of the individual have received first consideration. 

I'he effectiveness of this point of view can scarcely be denied. The 
practices associated with it have strengthened the individual as an 
energetic and productive member of the group. The individual who 
“asserts himself” is one to whom the social environment is especially 
reinforcing. The environment which has characterized Western dem¬ 
ocratic thought has had this effect. Tlie point of view is particularly 
important in opposition to despotic control and can, in fact, be 
understood only in relation to such control. The first step in the 
countercontrol of a powerful agency is to strengthen the controllee. 
If the governing agency cannot be made to understand the value of 
the individual to the agency itself, the individual himself must be 
made to understand his own value. The effectiveness of the tech¬ 
nique is evident in the fact that despotic governments have eventu¬ 
ally been countercontrolled by individuals acting in concert to build 
a world which they find more reinforcing, and in the fact that gov¬ 
erning agencies which recognize the importance of the individual 

have frequently become powerful. 

The use of such concepts as individual freedom, initiative, and 

responsibility has, therefore, been well reinforced. When we turn to 
what science has to offer, however, we do not find very comforting 
support for the traditional Western point of view. The hypothesis 
that man is not free is essential to the application of scientific method 
to the study of human behavior. The free inner man who is held 
responsible for the behavior of the external biological organism is 
only a prescientific substitute for the kinds of causes which are dis¬ 
covered in the course of a scientific analysis. All these alternative 
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causes lie outside the individual. The biological substratum itself is 
determined by prior events in a genetic process. Other important 
events are found in the nonsocial environment and in the culture of 
the individual in the broadest possible sense. These are the things 
which make the individual behave as he does. For them he is not 
responsible, and for them it is useless to praise or blame him. It does 
not matter that the individual may take it upon himself to control 
the variables of which his own behavior is a function or, in a broader 
sense, to engage in the design of his own culture. He does this only 
because he is the product of a culture which generates self-control or 
cultural design as a mode of behavior. The environment determines 
the individual even when he alters the environment. 

This prior importance of the environment has slowly come to be 
recognized by those who are concerned with changing the lot of 
mankind. It is more effective to change the culture than the indi¬ 
vidual because any effect upon the individual as such will be lost at 
his death. Since cultures survive for much longer periods, any effect 
upon them is more reinforcing. There is a similar distinction between 
clinical medicine, which is concerned with the health of the indi¬ 
vidual, and the science of medicine, which is concerned with im¬ 
proving medical practices which will eventually affect the health of 
billions of individuals. Presumably, the emphasis on culture will grow 
as the relevance of the social environment to the behavior of the 
individual becomes clearer. We may therefore find it necessary to 
change from a philosophy which emphasizes the individual to one 
which emphasizes the culture or the group. But cultures also change 
and perish, and we must not forget that they are created by individ¬ 
ual action and survive only through the behavior of individuals. 

Science does not set the group or the state above the individual or 
vice versa. All such interpretations derive from an unfortunate figure 
of speech, borrowed from certain prominent instances of control. In 
analyzing the determination of human conduct we choose as a start¬ 
ing point a conspicuous link in a longer causal chain. When an indi¬ 
vidual conspicuously manipulates the variables of which the behavior 
of another individual is a function, we say that the first individual 
controls the second, but we do not ask who or what controls the first. 
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When a government conspicuously controls its citizens, we consider 
this fact without identifying the events which control the govern¬ 
ment. When the individual is strengthened as a measure of counter- 
control, we may, as in democratic philosophies, think of him as a 
starting point. Actually, however, we are not justified in assigning to 
anyone or anything the role of prime mover. Although it is neceS' 
sar\' that science confine itself to selected segments in a continuous 
series of events, it is to the whole series that any interpretation must 
eventually apply. 

Even so, the conception of the individual which emerges from a 
scientific analysis is distasteful to most of those who have been 
strongly affected by democratic philosophies. As we saw in Chapter 
I, it has always been the unfortunate task of science to dispossess 
cherished beliefs regarding the place of man in the universe. It is easy 
to understand why men so frequently flatter themselves—why they 
characterize the world in ways which reinforce them by providing 
escape from the consequences of criticism or other forms of punish¬ 
ment. But although flattery temporarily strengthens behavior, it is 
questionable whether it has any ultimate survival value. If science 
does not confirm the assumptions of freedom, initiative, and respon¬ 
sibility in the behavior of the individual, these assumptions will not 
ultimately be effective either as motivating devices or as goals in the 
design of culture. We may not give them up easily, and we may, in 
fact, find it difficult to control ourselves or others until alternative 
principles have been developed. But the change will probably be 
made. It does not follow that newer concepts will necessarily be less 
acceptable. We may console ourselves with the reflection that sci¬ 
ence is, after all, a cumulative progress in knowledge which is due to 
man a/one, and that the highest human dignity may be to accept the 
facts of human behavior regardless of their momentary implications. 
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Ratio reinforcement, 102fF. 

Reaction formation, 357, 365, 376 
Reaction time experiment, 126 
Reader, 212 
Reasoning, 246f. 

Recall. 245f. 

Receptors, 281 

Reflex action, 47f.; range of, 49f. 
Refle.xes, 45-50, 111; in emotion, 166, 
169; in personal control, 316; in 
self-control, 233f. 

Reinforcement, 53, 65, 72ff.; and depri¬ 
vation, 149; at specified rates of 
responding, 105f.; delayed, 125; 
determining a “self,” 255; in eco¬ 
nomic control, 284f.; in education, 
405; in personal control, 317; in 
psychotherapy, 380ff.; in self-control, 
237; intermittent, 99f. See also Con- 
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ditioned rciiiforccrs, Differential re¬ 
inforcement, Interval reinforcement, 
Negative rcinforcers. Operant condi¬ 
tioning, Positive rcinforcers. Ratio 
reinforcement, \'ariablc-inter>al rein¬ 
forcement, \'ariablcratio reinforce¬ 
ment 

Reinforcers, 72-75; conditioned, 76f.; 
generalized, 77-81; generalized, and 
deprivation, 150. See also Positive 
reinforcers arid Negative rcinforcers 
Relations, responses to, 137f. 

Religion, 350-358 

Religious control. 350fT.; behavior re¬ 
sulting from, 355fT.; countercontrol 
of, 358; justification of, 358; opposed 
by psychotherapy, 37If.; techniques 
of, 352 

Repertoire, 422 

Repressed wishes and memories, 374 
Repression, 189, 290ff., 376; therapy 
for, 370 
Request, 308 
Resentment, 362 
Resistance, 371 
Resolution, 237 

Respondent (or Pavlovian) condition¬ 
ing, 65, 76; temporal relations in, 
125 

Response, 47 

Responsibility, personal, 240, 341f., 

447 

Restraint, physical. See Physical re¬ 
straint 

Retribution, 341f. 

Revolt, 359 

Revolution, political, 360 
Reward, 59-66 passim, 185 
Rh)Tne, 212 
Rhythm, 212 

“Right,” as reinforcer, 182 
“Right,” defined, 324; extended to 
customs and manners, 417f; in group 
control, 324 

Rights, human, 349, 447 
Robber)', 539 
Robespierre, 40 
Robinson Crusoe, 198 
Rogers, Carl R., 438f. 

Rorschach test, 274 
Rules of conduct, 339 


Rumford, Count, 52 
Russian character, 424 

Sailors, amusements of, 309 
Salvation, in justifying religious prac¬ 
tices, 358 
Sarton, George, 11 
Satan. 233, 357 
Satiation. See Deprivation 
Satisfying consequences as reinforcing, 
81 

Schedules, developmental, 1 56 
Schedules of reinforcement. 94-106, 
385f., 396; in the social environ¬ 
ment, 299 

Science, characteristics of, 12; misuse 
of, 3 

Science of behavior, 11 
Science of human behavior, objections 
to, 17flF. 

Sculpture, 293 
Season of birth, 24 
Security. 348, 391, 430 
Seeing, as response, 140; conditioned, 
266-270; operant. 270-275 
Self-control, 227-241; and culture, 
423; furthered by religious agencies, 
356f.; in therapy, 380; private, 275; 
techniques of, 231-240 
Self-detennination. 227ff., 242 
Self-knowledge, 261; absence of, 288ff.; 

and culture. 423; defective, 366 
Sclf-obser\’ation, 260f. 

Self, the, 283-294; as an organized 
system of responses, 285; relation to 
other selves, 286; unity of, 285f. 
Sensation, 276f.; operational definition 
of, 280f.; physiology’ of, 280f. 
Sensing, 140 
Sensory’ processes, 131 
Set, preparatory’, 128 
Sexual behavior, 142, 153, 187, 235, 
272, 292f.; control of, 420f. 

Sexual reinforcement, 84 
Shame, in group control, 325; in per¬ 
sonal control, 174, 187, 317 
Shaping behavior, 91-98 
“Sharp,” 136 
Shaw, G. B., 5Of. 

Sheldon, W. H., 25 
Shell shock, 28 
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Sheltered life, 354 
Shock therapy, 374 
■■Should.” See “Ought” 

Shvness. 365 
Sibling rivalry', 376 
Silence, putting on. 318 
Sinful behavior, 332f. 

Singing bv ear. 118f. 

Sin, sense of. 187, 353f. 

Sit down strike. 360 

Skill. 96. 407 

Skinner, B. F., 210 

Sleep, 155, 290 

Slip, Freudian, 378 

Slow down, 360 

Smile, dimensions of a, 301 

Smooth muscles, 49 

Sneeze. Ill 

Snubbing, 318 

Social bciravior, 297-312 

Social conscience, 287 

Social environment, 253, 298ff., 419 

Social episodes, 304-311 

Social forces, 36, 297 

Social reinforcement, 298fF. 

Social psychology, 16 
Social science, 297 
Social stimuli, 301ff. 

Social systems, 304f., 335 
Sociology, 15, 16, 415 
Solutions in psychotherapy, 382 
Solutions to a problem, 247 
Soporifics, 237 
Sorrow, 163 

Species differences, 75, 156ff. 

Sphincter control, 115 
Spontaneity, 48 
Stalking, 304 
Stamping in, 60fF. 

Stamping out, 182 
Statistics, 19 

Stimuli, analysis of, 130ff.; interpreta¬ 
tion of 138ff.; private, 261 
Stimulus, 47 

Stimulus control, defective, 365; tradi¬ 
tional problems in, 136ff. 

Stimulus manipulation, in making a de¬ 
cision, 243f.; in personal control, 
316f.; in problem solving, 249f.; in 
religious control, 354; in self-control, 
233f. 


Stimulus-response formulae, 110 
Stimulus substitution, 53 
Story of a Cheat, 380 
Strikes. 360 
Striped muscles, 49 
Stubbornness, 360 
Sty’le. 118, 304, 416 
Sublimation, 152, 377 
Subjective terms, 259 
Submissiveness, as generalized rein* 
forcer, 79 

Sucking behavior, 373 
Sugar as reinforcer, 84 
Sugar-coating the pill,/l33 
Suggestion, 210, 213^ 

Suicide, 223, 232 
Sulking, 262 

Summation, algebraic, 218f. 

Summator. See Verbal summator 
Superego, 29, 284 
Superstitution, 55, 84fF., 350f. 

Surgery in psychotherapy, 374 
Sur\'ival of a culture, 430f. 

Survival value, of a culture, 434; of re¬ 
flexes, 54f. See also Evolutionary ex¬ 
planation 
Swaddling, 425 
Syllogism, 250 
Symbolism, 292f. 

Symbols, 130, 132, 292ff. 

Sympathy, 163 

Symptoms, 56, 365, 373, 378f. 
Synesthesia, 268 
System, scientific, 14 

Taciturnity, 365 
Taste, 417 
Tear jerker, 56, 169 
Teasing, 299f. 

Temporal relations between stimulus, 
response, and reinforcement, 125-128 
Temptation, 233, 357 
Tendencies to behave, 62 
Tennis, 121 
Tests, 196f., 368 
Thematic probe, 215f. 

Thematic prompt, 214, 245 
Thematic suggestion. 213 
Theories of human behavior, 333f, 
Theory of the Leisure Class, 417 
Therapy. See Psychotherapy 
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Thinking, 242-256. 273, 411 

T'horeau, II. D., 360 

T'horndike. E. L., 39f., 84, 185, 392 

Thought, 276 

Threat, 177 

T’lirill-sccking, 364 

T'icklc, 2 59 

T’iine, as independent variable, 154ff. 
Timidity. 164 

T'obacco "cures,’' 56. 152, 236 
Token rcinforcers, 79 
T'otalitarian government, 21 
Tolstoi, ISf. 

T one-deaf, 269 
Toothache, 259 

T’opographical subdivisions of behavior 
as "selves,’’ 285 
T’opographv of behavior, 93f. 

Traits. I93ff.; not causes, 202; predic¬ 
tion in terms of, 199ff. 

Transfer. See Induction 
rrial and error learning, 64 
Trollope, Anthony, 223 
Truth scrums, 320 

Ulcers, 168, 363 
Unconscious behavior. 111, 289 
Unconscious thought, 252f. 

Units of behavior, 94 
Universality, 315 
Unpleasant consequences, 81 
Unpleasant stimuli. 171 
Unstable social interaction, 308f. 
Utopian thinking, 427 

Value, economic, 391f., 394f. 

Value judgments, 428 
\'andalisni. 360 

\'ariable-intersal reinforcement, 102, 

389 

Variable-ratio reinforcement, 104, 389, 

Variables controlling behavior, 31-35; 
with incompatible effects, 218 


X'eblen, Thorstein, 417 
X'cgct.irianism. 235 

Verbal behavior, 94, 95, 97, 210, 299, 
408; covert. 264 

Verbal Behavior, 210 (footnote) 

X'erbal episodes, 307f. 

N'erbal report, 280, 282 
Wubal responses to prisatc events, 258- 
261 

Wrbal summator, 215, 274, 289, 291 
X'irtue. 358 

X'irtuous behavior, 352f. 

Volition. 11 Of. 

X’oluntar)' beha\ ior, 110-116, 342f. 

Wages, 385f. 

W’ants, 145f. 

and Peace. 18 
Watt. James, 255 
W’ealth, 384 
W’ells, 11. G.. 50. 132 
Wetterhom, 137 
Whittington, Dick, 214 
Will power. 241 
Will. See Voluntary behavior 
Wish. 146, 374 
Wish, repressed, 184 
Wit. 377 
Witchcraft, 351 
XXTthdrawal symptoms, 364 
Women in Love, 234 
World within one’s skin, 257; study 
of. 280 

Word association e.vpcriments, 210, 215 
W’ord pictures, 270 
W'ordsworth, 45 
Work level, 422 
Worr>’, 168, 362 
Writers’ cramp. 72 
W'^riting. 254, 270, 274, 315 
"Wrong.” as reinforcer, 182 
"Wrong,” defined, 324; extended to 
customs and manners, 417f.; in group 
control, 325f. 



